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ABSTRACT 


A  study  has  been  made  of  problems  associated  with  production  yield  of 
electronic  materials  and  associated  devices.  The  fraction  of  starting  material 
resulting  in  useful  end-items  is  considered  as  the  effective  3deld  from  the  govern¬ 
ment’s  point  of  view.  Reliability  considerations  are  of  necessity  given  important 
weight  in  the  deliberations  of  the  Committee.  The  report  discusses  practical  prob¬ 
lems  of  fabrication  process  and  techniques,  problems  arising  from  current  practice 
in  specifications  and  standards,  and  problems  arising  from  system  applications 
and  use.  An  unusual  real-life  case  history  of  a  major  reliability  study  closes  the 
report. 


PREFACE 


The  Nation ^ I  Materials  Advisory  Board  of  the  Division  of  Engineering, 
National  Research  Council,  National  Academy  of  Scieace/National  Academy  of 
Engineering,  was  asked  by  the  Department  of  Defense,  Office  of  the  Director, 
Research  and  Engineering,  to  initiate  a  specific  sub-phase  in  the  then-current 
study  of  the  ^  hoc  Committee  on  Materials  and  Processes  for  Electron  Devices. 

The  sub-phase  was  to: 

1.  Identify  the  factors  influencing  production  yield  of  electronic 
materials  and  related  devices  from  the  point  of  view  of: 

a.  Processing 

b.  Fabrication 

c.  Reliability  and  reproducibility 

d.  Understanding  of  underlying  phenomena 

e.  Use 

2.  Consider  alternative  courses  for  solving  the  problems  which 
were  uncovered. 

3.  Recommend  programs  for  which  Government  support  would 
be  effective. 

4.  Make  such  other  recommendations  as  would  be  of  benefit 
to  the  Government  relating  to  production  yield  of  electronic 
materials  and  related  devices. 

In  November,  1970,  the  NMAB/NRC/NAS/NAE  assembled  an  ad  hoc 
Panel  under  the  chairmanship  of  Mr.  V.Tlliam  C.  Hittinger.  He  participated 
ex  officio  in  the  meetings  and  work  of  the  parent  NMAB  ad  hoc  Committee  on 
Materials  and  Processes  for  Electron  Devices  (Dr.  Jack  A.  Morton,  Chairman). 

The  other  Panel  members  did  not  attend  the  meetings  of  the  Committee  on  Materials 
and  Processes  for  Electron  Devices  nor  did  the  Committee  members  attend  the 
meetings  of  the  Panel.  However,  the  proceedings  of  each  endeavor  were  freely 
available  to  the  members  of  the  other.  No  problem  of  communication  existed. 

tx 


ilDViiBiifliii 


The  study  was  generally  organized  by  first  reviewing  oral  reports  by  the 
liaison  representatives  who  presented  the  needs  of  the  Services,  their  view  of  in¬ 
dustrial  problems,  their  cux'rent  activities,  their  future  plans,  and  relevant  resource 
material.  Thereafter,  task  forces  were  organized  to  develop  specific  studies  and 
recommendations . 

Three  task  forces  were  organized  among  the  Panel  members  and  liaison 
representatives.  No  distinctions  were  made  during  the  working  period.  The 
Panel  members,  however,  accept  sole  responsibility  for  the  conclusions  and  recom¬ 
mendations  of  the  study.  The  task  forces  and  members  were: 

Task  I  -  Fabrication 
I.  Arnold  Lesk,  Reporter 
Martin  M.  Atalla 
Morris  Chang 
Maurice  Chernoff 
Sohrab  K.  Ghandhi 
Paul  N.  Russell 

Task  II  -  Specifications  and  Standards 
Israel  Katz,  Reporter 
Bernard  Reich 
Jerome  J.  Suran 

Task  III  -  System  Application  and  Use 
Max  T.  Weiss,  Reporter 
Maurice  Chernoff 
Charles  Grodwin 
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The  organization  of  this  Report  is  as  follows: 
Prefator}'  Material 


Chapter  1 
Chapter  2 
Chapter  3 
Chapter  4 
Chapter  5 


Introduction,  Scope,  Methodology 
Conclusions  and  Recommendation^- 
Fabrication  Processes  and  Techniques 
Specifications  and  Standards 
System  Application  and  Use 


After  the  prefatory  material.  Chapter  1  covers  introduction,  scope, 
methodology,  exclusions,  criteria,  and  viewpoints.  For  the  benefit  of  decision¬ 
makers  and  resource  allocators,  all  the  major  conclusions  and  recommendations 
with  an  estimate  of  anticipated  benefits  are  brought  together  in  Chapter  2.  The 
three  task  group  presentations  which  give  the  background,  discussion  and  greater 
detail  for  the  conclusions  and  recommendations  may  be  found  in  Chapters  3,  4, 
and  5.  This  report  is  closed  by  an  unusual  appendix  which  is  a  real  life  report  of 
a  major  reliability  study  furnished  through  the  courtesy  of  the  General  Electric 
Company. 
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CHAPTER 


1.0  INTRODUCTION 

1.0.1  General  Experience  and  Background 

The  U.  S.  aemiconductor  industry  has  grown  to  an  annual  levrl  in  ex¬ 
cess  of  $1  billion  for  domestic  and  export  sales  during  the  approximately  20  years 
of  its  existence.  This  brief  period  has  been  paced  by  major  advances  in  the  ability 
t*.-  perform  complex  electronic  functions  at  an  ever-decreasing  cost  per  fimctioii. 

In  large  measure  the  fundamental  understanding  of  silicon  and  germanium  matecial 
and  device  physics  has  reached  a  very  high  level  of  sophistication, v.'hicb  k  adacuate 
to  support  continued  future  growth  in  application  to  advanced  products  in  ail  seg¬ 
ments  of  the  electronics  industry. 

Much  remains  to  be  done  to  improve  overall  cost  effect- vene^s  in  ap¬ 
plying  these  products  to  electronic  systems.  Both  the  component  manufactu  rer  a.:*! 
user  have  much  to  learn  in  dealing  with  the  uniformity  and  reliabililv’,  specificurK-n, 
selection  and  application  of  the  more  than  three  billion  units  per  year  wluch  are  being 
produced  at  this  time. 

Many  U.  S.  Government  agencies  feel  that  they  are  paying  too  much 
for  their  systems,  or  that  the  reliability  of  the  systems  they  get  is  not  adequatc 
(See  1.0.2).  In  some  cases,  even  after  expenditures  much  larger  than  origin -lly 
budgeted,  an  acceptable  system  was  still  not  produced.  There  are  examples  of 
"trial-and-error"  systems  that  eventually  performed  satisfactorily,  but  only 
as  the  result  of  expensive  rework  following  unsuccessful  first  attempts.  Although 

undoubtedly  many  factors  contribute  to  such  cases  cf  budgetary  and/or 
performance  failure,  the  semiconductor  component  parts  appear  to  bear  sorr-e  re¬ 
sponsibility,  On  the  other  hand,  there  are  examples  of  successfully  developi,.? 
systems.  Some  of  these  (Apollo,  Minuteman  III)  are  large  "reliable  comporirnt  ’ 
systems,  of  such  a  nature  that  the  consequences  of  a  failure  are  enormous.  Hence 
considerable  sums  of  money  were  invested  in  programs  to  achieve  soui  ces  of  re  ¬ 
liable  components  by  which  system,  i  with  predictable  Iiigh  reliability  could  be 
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designed  and  built.  It  may  be  argued  that  the  cost  oer  liighly  reliable  system  is 
large  and,  as  a  result,  there  is  room  to  question  whether  or  not  reliability  could 
have  been  obtained  more  economically  by  the  "trial-and-error"  technique.  It  is 
generally  accepted  that  the  "reliable  component"  approach  is  the  only  way  that 
reliable  systems  can  be  built;  there  is  much  tc  recommend  it  for  systems  of  all 
sizes.  This  is  not  to  say  that  success  is  giaranteed  by  such  an  approach;  some 
iarge  systems  that  attem^nted  a  "reliable  component"  approach  still  got  into 
diff>:iilties  because  cf  problems  with  semiconductor  components.  In  terms  of  our 
ovcra-  erienoe,  then,  the  question  addx’essed  by  this  study  may  be  restated  as 
heat  capitalize  on  our  collective  knowledge  to  promote  the  design  and 
fji  .SuctJca  .'f  Semiconductor  components  for  reliable,  economical  systems  ?' 

1,  r  2  Dspaitrasat  of  Defense  Inputs 

£<.. -,ly  iii  the  deliberations  of  the  Panel  it  became  appa-'ent  that  the 
lir  iiioc  represci-  atiras  shared  a  common  view  relating  to  the  use  of  semiconductor 
de'^ices  In  oiectronic  equipment;  namely,  that  the  DoD  Services  are  spending  too 
much  moiioy  x  ■’  the  value  of  their  electronic  equipment,  'j’hey  exemplified  the 
sUuation  in  many  ways: 

.  field  maintenance  of  solid  state  electronic  equlpnien!: 

is  too  expensive  and  difficult  , 

.  reliability  of  solid-state  electronic  equipment  is 
disappointing. 

.  semiconductor  devices,  integrated  circuits  in  particular, 
are  procured  for  use  in  military  equipment  in  a  wide 
variety  of  wajs,  often  with  little  -egard  to  end  use. 

.  semiconductor  devices,  supplied  for  military  end-'use, 
often  have  latent  manufacturing  defects. 

.  there  is  little  knowledge  of  differences  in  cost 

effectiveness  between  use  of  military  standard  and 
non  "-military  standard  parts. 


The  Panel  concluded  that  there  is  a  general  problem  in  this  field  worthy 
of  study,  blit  no  quantitative  assessment  of  the  problem  was  made.  The  members 
also  concluded  that  they  would  have  to  carefully  define  and  channel  their  activities 
since  the  questions  raised  by  the  liaison  representatives  had  implications  well  beyond 
the  purview’  and  time  available  to  the  group. 

The  Charge  to  the  Panel  was  to  focus  on  "the  yield  of  electronic  ma¬ 
terials  and  devices. "  The  Panel  chose  to  define  yield  very  broadly  as  the  ratio  of 
usable  silicon-based  devices  in  a  military  system  to  the  input  of  silicon  at  the  front 
end  of  the  manufacturing  process.  Silicon-based  technology  was  focused  on  in  depth 
as  being  generically  applicable  to  electronic  materials  and  devices.  This  approach 
was  deemed  most  responsive  to  the  interest  of  the  sponsor. 

It  became  readily  apparent  that  the  main  liaison  representative  con¬ 
cerns  were  with  matters  usually  considered  as  reliability-related:  namely,  the 
selection,  specification  and  manner  of  use  of  a  device  for  high  system  reliability, 
rather  than  the  aspects  of  material,  process,  and  structure  associated  with  manu¬ 
facturing  yield,  per  se.  The  liaison  representatives  were  concerned  with  device 
failure-related  phenomena,  but  they  viewed  these  matters  as  being  the  primary 
responsibility  of  the  vendor.  The  Department  of  Defense  has  been  a  continuing 
and  important  sponsor  of  research  and  deyeloppieat  of  manufacturing  methods  in 
the  solid  state  electronics  field.  Therefore,  the  Panel  decided  to  examine  in  a 
balanced  way  all  aspects  of  yield,  defined  above,  relevant  to  present  concerns 
about  the  expense  of  solid-state  electronic  systems. 

1.1  SCOPE* 

There  are  many  electronic  materials,  processes, and  devices  of  in¬ 
terest  to  DoD,  but  the  problem  stated  by  the  liaison  representatives:  "DoD 
pays  {00  much  for  what  it  gets,  "  had  such  an  immediate  ring  to  it  that  the  Panel 
decided  to  limit  its  considerations  to  silicon  semiconductor  device  technology, 


+  cf.  1.3  infra. 


fabrication,  test,  specification,  and  use.  The  Panel  also  recognized  that  many  yield- 
related  considerations  of  other  electronic  materials  were  involved  in  the  concurrent 
study*  by  the  ad  hoc  Committee  on  Materials  and  Processes  for  Electron  Devices, 
so  that  the  focus  on  silicon  devices  was  considered  to  be  in  order.  This  was  partic¬ 
ularly  so  since  it  was  agreed  that  the  generic  nature  of  the  silicon-based  study  would 
be  capable  of  broad  extrapolation  and  application. 

In  sum,  the  objectives  of  this  study  are  to  identify  those  problem  areas 
from  raw  silicon  to  device  use  in  military  systems  that  adversely  affect  yield  and 
to  submit  implementable  recommendations  for  yield  improvement. 

1.2  METHODOLOGY 

The  Panel  used  a  case-study  approach.  Real  situations  were  described 
and  investigated  in  both  government  and  industry  sectors.  A  number  of  Task  Force 
members  made  visits  to  military  contractors  for  direct  observation  and  interview. 
Some,  but  not  all,  of  the  case  studies  are  identified  in  this  report.  All  were  dis¬ 
cussed  by  the  Panel  in  the  course  of  its  deliberations. 

1.3  OTHER  CONSIDERATIONS  AND  EXCLUSIONS 

In  the  course  of  the  study,  the  Panel  discussed  certain  management  and 
policy  questions  but  considered  them  inappropriate  for  implementation  in  specific 
recommendations.  Worthy  of  mention  in  the  context  of  the  relationship  betw'een  yield 
and  reliability  are  the  following; 

Concern  was  expressed  about  the  skill  level  required  of  military  pro¬ 
curement  personnel.  A  suggestion  was  made  to  classify  the  appraisal  of  the  reliability 
aspect  of  procurement  of  devices  as  an  R  &  D  activity,  thereby  providing  a  means  of 
upgrading  this  function. 

The  manufactiue  of  semiconductor  devices  in  offshore  locations**  was 
discussed  extensively,  liaison  representatives  expressed  concern  about  the  use  of 
such  products  in  military  equipment.  Questions  were  raised  about  the  ability  to 
control  integrity  of  manufacture  in  an  offshore  plant,  the  erosion  of  domestic  manu¬ 
facturing  capability  and  related  logistics  problems  in  the  event  of  war,  and  the 

*  Materials  and  Processes  for  Electron  Devices.  NMAB-289 
**  Offshore  is  used  here  to  mean  location  in  a  foreign  country. 
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possibility  of  sabotage  in  offshore  factories.  During  the  discussion  the  following 
points  were  made: 

.  There  is  a  continuing  world-wide  trend  toward 
^iSsembly  of  semiconductor  devices,  particularly 
integrated  circuitst  in  offshore  plaiits.  This  is 
happening  as  a  consequence  of  intense  price  com¬ 
petition  in  the  industry. 

.  Reliability  of  semiconductor  devices  is  unrelated 
to  geographic  location  of  manufacture.  There  are 
many  examples  of  the  ability  to  produce  reliable 
products  in  well  disciplined  cxfshore  plants.  The 
determining  criterion  is  the  management  ability 
to  run  a  skilled  factory;  this  ability  is  not  necessarily 
geography-related. 

.  There  are  emerging  trends  in  semiconductor 

fabrication  toward  design  that  can  be  assembled 
with  minimum  operator  effort;  e.g. ,  beam  lead  and 
"bump"  connections.  Success  in  these  areas 
could  minimize  'he  need  for  offshore  assembly  in 
the  future. 


The  governme.nt  must  recognize  the  need  to  pay 
appropriately  for  domestically  manufactured  products 
where  it  is  deemed  essential  to  procure  such 
devices.  There  must  not  be  an  exclusive  insistence 
on  lowest  first  price  in  such  procurements;  but, 
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A  question  was  raised  about  the  need  or  desirability  of  the  government 
undertaking  its  own  manufacture  of  semiconductor  devices  in  an  arsenal  complex 
as  a  means  of  retaining  domestic  source  of  supply  and  obtaining  required  high  re¬ 
liability  levels.  The  Panel  felt  that  taking  advantage  of  the  large  volume 
manufacture  of  U.  S.  industry  is  the  best  means  for  low  device  cost  and  high  re¬ 
liability,  and  that  v/hat  is  required  is  to  learn  best  how  to  control  such  manufacture 
and  specify  and  procure  for  military  requirements. 

No  attempt  has  been  made  to  identify  deficient  contractors  or  agencies 
in  this  report,  although  a  high  level  of  frank  interchange  occurred  in  deliberations. 
Rather,  effort  was  made  to  identify  generic  problems  and  solutions  with  appropriate 
recommendations . 

Conclusions  and  Recommendations  arc  summarized  in  Chapter  2; 
they  are  contained  in  greater  detail  in  Chapters  3  through  5. 


CHAPTER  2 


2.0  SUMMARY  OF  CONCLUSIONS  AND  RECOMMENDATIONS 

ance  we  are  dealing  with  a  mature  technology,  the  reader  will  under¬ 
stand  that  it  is  necessary  to  make  many  specific  recommendations  as  well  as  a  few 
broadly  based  recommendations  for  major  change.  The  Panel's  main  conclusions, 
recommendations  and  anticipated  benefits  are  summarized  in  this  Chapter.  First 
they  are  grouped  into  three  categories  of  task  force  studies: 

.  Fabrication  Processes  and  Techniques 

.  Specifications  and  Standards 

System  Application  and  Use 

Following  this  they  are  ordered  by  priority,  thereby  signifying  the  best  judgment  of 
the  Panel  as  to  relative  importance.  The  reader  is  referred  to  the  appropriate 
chapter  for  more  detailed  discussion  of  each  point. 

FABRICATION  PROCESSES  AND  TECHNIQUES 
Crystax  Defects 
Conclusi'.n 

Crystal  lattice  defects  can  result  in  yield  losses  in  such  large  axea 
devices  as  power  transistors  (low  and  high  frequency),  thyristors,  and  complex 
integrated  circuits.  The  role  of  defects  in  reducing  yield  and  the  means  by  which 
they  may  be  introduced  during  crystal  growth  and  in  the  manufacturing  process  are 
not  well  understood. 

2. 1.1. 2  Recommendation 

A  program  should  be  supported  to  elucidate  the  fundamental  processes 
by  which  crystal  defects  are  initiated,  and  by  which  they  move  and  multiply  in  a 
silicon  wafer  during  processing.  This  program  should  aim  at  determining  the 
mechanisms  by  which  these  defects  are  created  during  processing,  and  should  aid 
in  the  formulation  of  low  defect  processing  procedures. 


2.1 

2.1.1 
2. 1.1.1 
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2. 1.1. 3  Anticipated  Benefits 

Higher  device  yields  with  possibly  greater  device  uniformity,  leading 
to  more  tightly  controlled  device  parameters;  may  be  expected.  This  in  turn,  should 
directly  improve  the  margin  of  tolerance  which  can  be  allowed  in  circuit  designs, 
and  lead  to  the  design  of  more  reliable  circuits. 

2.1.2  Metallization 

2. 1.2.1  Conclusion 

The  p”oblem  of  metallization  of  conductor  paths  in  integrated  circuits 
is  a  major  contributor  to  decreased  yield  and  poor  reliability.  This  is  especially 
true  when  the  conductors  are  subject  to  thermal  cycling,  high  peak  current  pulses, 
or  to  low  level  corrosion.  This  problem  is  greatly  exacerbated  when  conductors  are 
deposited  over  large  steps  on  the  oxide  surface  and  when  they  contact  very  shallow 
p-n  junctions.  In  particular,  the  problem  of  metallization  has  slowed  progress  in 
complex  large  scale  integration,  where  two  or  more  metallization  layers  are  de¬ 
sirable. 

2. 1.2. 2  Recommendations 

A  program  should  be  instituted  which; 

.  Aims  at  discovery  of  the  fundamental  failure  modes 
that  are  presented  in  various  metal  systems,  under  a 
variety  of  stressful  conditions,  e.g. ,  high  current 
density,  large  steps  in  the  oxide,  temperature-power- 
current  cy^’ing,  etc. 

.  Aims  at  development  of  quantitatively  con  rollable 
procedures  by  which  the  risk  level  in  these  failure 
modes  can  be  minimized. 

.  Undertakes  to  transfer  these  procedures  to  actual 
manufacturing  practices  with  the  assurance  that 
benefits  of  this  work  will  be  ongoing. 
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2.1.2. 3  Anticipated  Benefits 

This  program  should  lead  to  enhanced  reliability  and  more  effective 
reliability  assurance,  thereby  giving  higher  yields  of  large-scale  integrated  circuits. 

2.1.3  Bonding 

2.1.3. 1  Conclusion 

Both  die  and  wire  bonds  are  primary  areas  for  failure  of  semicon¬ 
ductor  devices  and  integrated  circuits.  It  is  expected  that  the  chip  size  as 
well  as  the  number  of  terminal  pads  will  increase  in  the  future,  due  to  the  need  for 
increasingly  complex  large-scale  integrated  circuits.  Hence  these  problem  areas 
can  be  expected  to  become  more  serious  in  the  future. 


2.1.3. 2  Re  commendations 

A  program  should  be  developed  to: 

.  Achieve  quantitative  basic  understanding  of  what 
occurs  when  die  and  wire  bonding  are  performed. 


.  Explore  new  r.ietaUurgical  systems  for  these 
functions. 

.  Explore  new  bonding  systems  that  will  increase 
process  control  now  seemingly  inherently  deficient 
in  bonding  processes. 

.  Develop  methods  for  evaluating  the  quality  of 
bonds,  preferably  in  a  non-destructive  manner. 

2. 1.3.3  Anticipated  Benefits 

Enhanced  reliability  and  more  effective  reliability  assurance  may  be 
anticipated  with  beneficial  impact  on  cost-effectiveness. 

2.1.4  Plastic  Encapsulation 

2. 1.4. 1  Conclusion 

Economic  pressures  are  leading  to  a  growing  use  of  plastic  encapsu¬ 
lated  semiconductor  components,  in  particular,  integrated  circuits.  These  devices 
are  providing  adequate  service  in  a  variety  of  nonmilitary  products.  They  have  been 
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excluded  from  most  military  systems  because  of  concern  for  their  ability  tr  meet 
stringent  environmental  conditions.  There  is  a  considerable  variability  in  the  be¬ 
havior  of  these  devices  under  high  stress;  this  is  a  reflection  of  the  poor  understanding 
of  polymeric  materials  and  their  processing  for  this  application. 

2. 1. 4. 2  Recommendations 

A  program  should  be  established  to: 

.  Study  the  various  classes  of  macromole cular 
encapsulants. 

.  Study  the  basic  mechanisms  by  which  these  are 
polymerized  during  encapsulation. 

.  Study  their  basic  properties,  which  relate  to 
reliable  microcircuit  encapsulation.  This 
part  of  the  program  should  be  directed  at  develop¬ 
ment  of  means  for  precisely  specifying  the  formulations 
for  these  encapsulants  so  they  may  be  well  con¬ 
trolled  and  their  proper  use  in  the  molding 
operation  strictly  delineated. 

.  In  addition,  the  study  should  focus  attention  on 
inspection  screens  for  plastic  encapsulated 
semiconductor  components,  since  these  are  not 
now  fully  effective  in  establishing  quality 
assurance. 

2.1.4. 3  Anticipated  Benefits 

Plastic  packaging  is  an  important  approach  for  reducing  costs 
of  components.  This  cost  saving  could  be  applied  to  appropriate  government  systems 
provided  adequate  reliability  and  quality  assurance  are  demonstrated. 


11 


2.1.5 
2. 1.5.1 


Hermetic  Packaging 
Conclusion 


At  the  present  time  hermetic  encapsulation  is  used  for  most  military 
transistors  and  microcircuits.  The  reliability  of  this  form  of  packaging  is  affected 
by  many  factors:  contamination  that  is  present  within  the  package  before  lidding, 
sealing  contamination,  and  subsequent  contamination  due  to  voids  in  improperly 
formed  seals.  All  of  these  forms  of  contamination  can  result  in  longHerm  failure. 


2. 1.5. 2 


Re  commendation 


A  program  should  be  instituted  to  characterize  the  detailed  nature  of 
the  seal  on  hermetic  packages,  to  evolve  better  hermeticity  tests,  and  to  develop 
techniques  by  which  large-area  seals  can  be  formed  with  assurance  of  integrity. 
Better  techniques  for  detecticg  and  eliminating  contaminants  that  get  sealed  within 
the  package  should  be  part  of  this  program.  In  aaoition,  new  ways  of  sealing  the 
microcircuit  at  the  chip  level  ahould  be  investigate  ' .  with  a  view  toward  reducing 
the  effects  of  contamination  and  improper  hermetic  encapsulation. 


2. 1.5.3 


Anticipated  Benefits 

Enhanced  reliability  and  more  effective  reliability  assurance  may 


be  ejqpected. 


Reliability  Assurance 
Conclusion 


The  effectiveness  of  reliability  assurance  procedures  is  limited  by 
the  degree  of  our  understanding  of  failure  mechanisms.  Relatively  little  research 
and  development  effort  directly  applied  to  Physics  of  Failure  has  b«jen  sponsored 
(although  the  fine  work  of  the  Air  Force's  Rome  Air  Development  Center,  among 
others, is  recognized). 


2. 1.6.2 


Recommendations 


Sponsor  programs  to: 

.  Establish  more  meaningful  and  economical  s'''*eens 
that  are  materials/process  oriented  rather  than 
component  oriented. 

.  Evolve  pertinent  high-stress  (destructive)  tests  for 
faster  and  more  accurate  reliability  prediction. 

.  Perform  research  and  development  in  physics  of 
failure  relating  to  the  dominant  failure  modes. 

.  Study  new  techniques  for  more  effective  production 
control  of  materials  and  processes. 

.  Evolve  effective  techniques  for  the  economical  re¬ 

liability  assurance  of  low-volume  parts, 

2. 1.6. 3  Anticipated  Benefits 

A  more  quantitative  understanding  of  failure  mechanisms  pertinent 
to  semiconductor  components,  leading  to  better  screens  and  more  meaningful 
interpretation  of  destructive  tests  would  be  achieved.  Effective  screens  for  low- 
volume  parts  would  be  developed. 

2.1.7  Procurement 

2. 1.7.1  Conclusion 

Procurement  practices  contribute  in  a  major  way  to  the  problems  en¬ 
countered  by  the  government  in  obtaining  high-yield,  reliable,  economical  systems. 
Modernization  of  procurement  procedures  should  be  done  periodically.  Although 
effective  procurement  procedures  have  been  established  by  the  military  agencies 
and  NASA,  there  is  a  need  for  consolidation  and  integration.  In  many  cases 
established  procurement  procedures  are  not  practiced. 


. . : . 
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2. 1.7. 2  Re  commendations 

.  Sponsor  a  program  to  compile  a  listing  of  the  various 
agencies,  documents,  procedures, and  reports  relating 
to  the  procurement  of  high-reliability  semiconductor 
components. 

.  Study  the  economics  of  high-reliability  ("hi-rel") 
component  procurement  as  they  relate  to  system 
cost  and  performance  to  ascertain  what  first  cost 
for  components  wou.M  make  economic  sense. 

.  Report  on  the  practices  of  competitive  bidding  as 
they  affect  the  ability  of  the  system  manufacturer  to 
use  the  best  techniques  for  "hi-rel"  assurance. 

.  Stuay  the  economic  problems  of  line  certification  as 
they  relate  to  volume  of  production. 

.  Recommend  ways  in  which  production  control  may 
be  more  effectively  implemented  and  documented. 

.  Perform  and  publish  failure  analysis  related  to 

specific  production  processes  for  use  in  follow-on 
procurement. 

2. 1.7. 3  Anticipated  Benefits 

This  Panel  anticipates  that  a  better  understanding  of  the  semiconductor 
device  procurement  system  and  how  it  works,  will  be  achieved,  ’oading  to  an  im¬ 
proved,  integrated  procurement  system  for  all  government  agencies  with  benefits 
of  economy,  reliability,  and  scheduling. 


2.1.8  Govemir;ent  Agoncy-Indnstry  Commi.cee 

2.1. 8.1  Coaclggion 

Various  ?overtiir 'out  agencies,  professional  societies  and  semicon¬ 
ductor-component  suppliers  are  working  together  to  establish  high-reliability  (hi- 
rel)  procedures  for  semiconductor  components.  However,  there  is  a  lack  of  co¬ 
ordination,  duplication  of  effort,  and  self-centeri2d  motivation. 

2. 1.8. 2  Recommendation 

A  government-industry  committee  should  be  constituted  to  implemer  . 
mobilization  of  the  hi-rel  practices  used  today,  extract  meaningful  data  from  past 
and  present  hi-rel  programs,  assist  in  standardization  of  documents,  and  promote 
the  exchange  and  dissemination  of  pertinent  information. 

2. 1.8. 3  Anticipated  Benefits 

Establishment  of  a  single  government-industry  committee  to  coordinate 
semiconductor  component  hi-rel  activities  should  lead  to  improved  economy  and 
effectiveness  of  hi-rel  procedures. 

2.2  SPECIFICATIONS  AND  STANDARDS 

2.2.1  Specification  Rigidity 

2. 2. 1.1  Conclusion 

Military  (MIL)  specifications  are  too  rigid.  Furthermore,  they  do 
not  keep  up  with  the  state  of  the  art.  In  particular,  they  currently  are  not  suf¬ 
ficiently  specific  to  end-applications.  One  useful  approach  might  be  to  modify  them 
for  classes  of  service. 

2. 2. 1.2  Ftecommendations 

The  scope  of  specifications  should  be  limited  by 
class  of  service. 

.  An  effort  should  be  made  to  supply  specification  formats 
that  would  help  the  specification  writer.  These  formats 
should  be  living  documents  subject  to  planned  periodic 
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change  by  a  group  of  competent  individuals  v,ith 
adequate  device  experience  and  laboratory  backup, 
assigned  to  specification  research  and  development. 
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The  flexibility  of  military  specifications  should  be  in¬ 
creased  by  limiting  their  use  in  logi  Stic  documentation 
and  by'  preparing  and  using  them  primarily  for  new 
equipment  applications. 

For  those  components  fabricated  by  high--volume 
production,  there  should  be  government  leadership 
in  the  area  of  device  specification  because  no  single 
industrial  contractor  is  in  a  position  to  exert  the  broad 
leadership  required. 


2. 2. 1.3  Anticipated  Benefits 

Use  benefits  should  more  closely  match  dollars  spent  for  procure¬ 
ment. 

2.2.2  Application  and  Use 

2. 2. 2.1  Conclusion 

There  are  many  factors  influencing  device  reliability  (and,  hence, 
apparent  yield)  which  are  related  not  only  to  fabrication  but  also  to  subsequent  in¬ 
tegration  and  use  in  subsystems  and  systems  operating  in  a  field  environment. 


2, 2. 2. 2 


Re  commendations 


Competent  support  under  one  organization  must  be  supplied 
to  assure  that  no  interface  problems  arise  concerning 
the  application  of  devices  to  circuits  and  from  circuits 
to  higher  levels  of  integration.  Standard  procedures  must 
be  developed  to  guarantee  the  smooth  integration  of 
these  parts. 
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A  practfcai  system  must  be  developed  whereby 
feedback  >  obtained  from  the  equipment  developers 
and  users.is  made  available  lo  the  device  designer  so  J^hat 
deficiencies  in  de’.dce  design  and  fabrication  can  bo  identified 
and  con  c-cted. 

2. 2. 2. 3  Anticipated  Benefits 

Redesign  as  a  result  of  field  laiiure  SAperience  will  be  minimized. 
Design  improvement  as  a  result  of  experience  will  be  accelerated.  In  our  concept 
of  yield  a  marked  improvement  may  be  ejq)ected. 

2.2.3  Commercial  Practices 

2. 2. 3.1  Conclusion 

Experience  has  shown  that  well-managed  use  of  high-volume-produced, 
commercially  available  semiconductor  devices  in  military  equipment  can  provide 
performance  and  reliability  equal  to  that  of  counterpart  military  standard  devices. 
Moreover,  data  accumulated  on  system  reliability  show  that  not  only  does  the  pro¬ 
duction  of  complex  electronic  equipments  pass  through  a  shakedown  phase  before 
desired  reliability  is  achieved,  but  also  that  non- military  standard  devices  have 
performance  and  reliability  characteristics  after  production  shakedown  that  qualify 
them  for  applications  in  military  equipments. 

Although  the  use  of  non-military  standard  devices  in  the  production 
and  maintenance  of  military  equipment  is  not  without  risk,  significant  cost  reduc¬ 
tion  and  system  reliability  improvements  may  be  attainable. 

2. 2. 3. 2  Recommendation 

The  government  should  undertake  a  program  to  determine  whether 
high-volume-produced,  non-military  standard,  commercially  available  devices, 
particularly  large-scale  integrated  circuits  could  be  utilized  in  different  generic 
islasses  of  equipment,  in  a  truly  cost-effective  manner,  where  cost-effectiveness 
is  measured  over  the  life  cycle  of  the  equipment. 
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2.2o3.3  Anticipated  Benefits 

Large  cost  savings  may  be  realised  if  acceptable  commercial  practices 
as  v/ell  as  non-military  standard,  «?cmmercially  available  devices  were  used  in  the 
production  of  large-quantiry  military  equipment. 

2.2.4  Equipment-Reliability  Enhancement 

2.2.4. 1  Conclusion 

Reliability  enhancement,  device  or  equipment  standardization,  and 
systems  failure  analyses,  as  currently  practiced, are  often  assigned  to  the  manu¬ 
facturing  phase  of  the  equipment-procurement  process.  Consequently,  they  may 
not  receive  adequate  attention  from  persons  vith  appropriate  levels  of  technical 
competence.  Moreover,  sufficient  design  effort  to  improve  levels  of  device, 
equipment  and  system  performance  or  to  reduce  equipment  downtime,  thereby 
greatly  extending  system  operating  life  between  overhauls,  is  seldom  part  of  a 
procurement  contract.  Yet,  a  significant  increase  in  the  field  life  of  equipment 
between  overhauls  should  be  an  attainable  goal. 

Equipment-procurement  costs  are  easily  identifiable  and  in  most  in¬ 
stances  readily  determinable.  Reliability  assessment  is  more  difficult  to  perform. 
Fund  allocations  for  reliability  enhancement  ofcen  are  not  given  appropriate  con¬ 
sideration  and  priority. 

2. 2. 4. 2  Recommendation 

The  history  of  the  reliability  and  the  actual  life  of  existing  equipment 
should  be  a  decisive  factor,  in  combination  with  original  price,  for  selection  and 
procurement  of  subsequent  devices  and  equipment.  To  obtain  such  data  in  order  to 
apply  experience  to  the  design  and  production  of  new  equipment  will  require  specific 
funding  for  reliability  improvement  in  procurement  contracts.  Therefore,  reliability 
enhancement  should  become  a  procurement  requirem.er.t. 
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2. 2. 4. 3  Anticipated  Benefits 

A  useful  criterion  for  bid  evaluation  wiU  be  achieved.  An  incentive 
for  ongoing  product  improvement  vill  be  incorporated  in  the  systems.  Net  mission 
cost  should  be  reduced. 

2.2.5  Screening  and  Burn-In 

2. 2. 5.1  Conclusion 

Screening  and  burn-in  at  both  the  device  and  subsystem  levels  have 
been  useful  in  detecting  nonconformance  and  early  failure.  The  DoD  position 
relative  to  general  application  of  screening  and  burn-in  is  not  clear.  If  the  tech¬ 
niques  are  effective  in  lessening  early  failures,  then  they  should  be  made  manda¬ 
tory  for  all  components  and  subsystems  procured  by  DoD. 

At  present,  the  sequence  of  screening  and  burn-in  is  a  fixed  pattern 
of  tests  for  all  detail  specifications  based  on  test  methods  in  MIL-STD-750  and 
MIL-STD-883. 

2.2.5. 2  Recommendations 

Device  and  subsystem  screening  and  burn-in  should  be  studied  as 
techniques  for  enhancing  system  reliability  and  cost  effectiveness.  Recognition 
should  be  given  to  the  need  for  greater  flexibility  in  applying  the  preconditioning 
and  burn-in  sequence  according  to  class  of  service. 

2. 2. 5. 3  Anticipated  Benefits 

Higher  yield  through  greater  reliability  of  screened  components 
should  be  attained. 

2.3  SYSTEM  APPLICATION  AND  USE 

2.3.1  Conclusion 

Development  and  procurement  procedures  for  highly  sophisticated 
and  critical  DoD  weapons  systems  often  result  in  less  than  satisfactory  field 
performance  because  of  high  component-failure  rates,  particularly  in  integrated 
circuits.  Though  the  initial  cost  of  the  integrated  circuits  may  seem  to  be 
reasonable,  the  impact  on  cost,  schedule  and  operational  readiness  cf  failures 
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at  higher  levels  of  assembly,  or  of  field  failures,  leads  to  the  conclusion  that  im¬ 
proved  techniques  must  be  devised  to  ensure  dependable  high  reliability  at  the  com¬ 
ponent  level.  This  is  particularly  true  for  mission  critical  aircraft  and  space  and 
missile  systems. 

Although  the  previous  recommendations  would  clearly  improve  this 
situation,  the  Panel  recognizes  that  some  major  critical  national  programs  have 
developed  effective  techniques  for  the  utilization  >f  electronic  components  that  en¬ 
sure  u  very  high  level  of  dependability  and  reliability.  These  techniques  involve 
focusing  man^ement,  engineering,  and  fiscal  attention  on  reliability  as  a  main 
goal,  a  condition  that  has  been  difficult  to  apply  to  the  broad  spectrum  of  military 
systems. 

It  is  clear  that  not  all  programs  can  be  elevated  in  importance  to 
command  the  funding  and  sustained  effort  in  the  component-acquisition  program 
that  is  put  into  the  few  exceptional  programs;  the  following  question  still  arises: 

"Can  DoD  as  a  whole  use  its  immense  resources  and  purchasing  power  to  achieve 
a  very  high  level  of  reliability  (and  thereby,  improve  yield)  for  all  its  mission 
critical  aircraft  and  space  and  missile  programs?  Can  it  do  this  by  cost-sharing 
among  programs  without  burdening  each  individual  program  with  excessive  costs?" 

This  concept  of  total  component  management  is  viewed  as  the  overall 
means  by  which  various  of  the  preceding  procurement  recommendations,  recognition 
of  classes  of  service  (2.2.1)  and  use  of  certain  commercial  practices  (2.2.3),  in 
particular,  can  best  be  judged  in  total  perspective.  The  Panel  believes  that  a 
study  in  greater  depth  than  was  possible  in  this  effort  should  be  undertaken  to 
evaluate  the  long-range  implications  of  the  total  management  concept.  A  suggested 
course  of  action  based  on  the  considerations  of  Chapter  5  (q.  v)  are  set  forth  below. 

2.3.2  Recommendations 

.  Establish  a  committee  of  highly  qualified  and  experienced 
individuals  both  in  and  out  of  government.  These  indivi¬ 
duals  should  have  backgrounds  in  both  the  technical  and 
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management  areas  of  DoD  systems  in  order  to  study 
tue  advisability  and  practicality  of  establishing  a 
single  DoD  agency  with  responsibility  and  authority 
for  consolidating  the  management,  procurement, 
and  technical  surveillance  of  high-reliability  components 
for  military  applications.  This  agency  should  con¬ 
cern  itself  with  all  devices,  whether  procured  by 
the  government  or  by  its  contractor  for  high-  re¬ 
liability  military  systems. 

This  committee  should  also  address  itself  to  the 
problems  of  developing  programs  and  techniques 
for  ensuring  a  continuing  advancement  in  reliable 
component  technology',  with  emphasis  on  integrated 
circuits.  This  advancement  might  otherwise  be 
stifled  by  the  constraints  to  use  specific  approved 
types  such  as  those  that  a  single-a§  mcy  [..ocure- 
ment  system  might  impose. 

2,3.3  Anticipated  Benefits 

The  vast  purchasing  power  of  DoD  could  be  used  to  improve  com¬ 
ponent  yield,  reliability,  and,  thereby,  overall  system  cost.  Fui-ther,  the  con¬ 
siderable  benefits  potentially  available  from  current  experience  in  methods  de¬ 
veloped  in  obtaining  high  reliability  in  mission-critical  programs  su.  as  Apollo 
and  some  missile  and  space  programs  could  be  exploited  in  many  DoD  programs. 

2.4  PRIORITY  ORDERING  OF  RECOMMENDATIONS 

The  recommendations  made  in  the  preceding  paragraphs  are  ordered 
in  priority  in  the  follovdng  table  according  to  criteria  related  to  the  broad  question 
of  electronic  equipment  cost  effectiveness.  The  Panel  regrouped  its  recommenda¬ 
tions,  listed  previously  by  Task  Force  category  into  categories  of  Fabrication.  Reliability, 
and  Reliability  Assurance,  and  Specifications  and  Procurement.  In  so  doing  it  was 
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decided  that  each  category  has  approximately  equal  importance  in  relation  to  yield 
as  defined  for  this  study.  The  priorities  assigned  in  the  following  table,  therefore, 
apply  only  within  the  category.  No  attempt  was  made  to  v;eight  the  ratings  from 
category  to  category.  Prioritiss  are  assigned  from  A  through  D  in  descending 
order  of  importance  to  DoD. 

Table  -  Priority  Ordering  of  Recommendations 


Recommendation 
Number  (s) 


Fabrication 


Crystal  Defects 

2.1.1 

Metallization 

2.1.2 

Bonding 

2. 1.3 

Plastic  Encapsulation 

2.1.4 

Hermetic  Packaging 

2.1.5 

Production  Control 

2.1  -  2.5 
Inclusive 

2.1.6  (.  -  #4) 

Reliability  and  Reliability  Assurance 

Nondestructive  Testing 

2.1.6  (.  -  #1) 

High-Stress  Destructive  Testing 

2.1.6  (.  -  #2) 

Physics  of  Failure 

2.1.6  (.  -  #3) 

Screening  ana  Bum-in 

2.1. 6. (.  -  #5), 
2.2.5 

Specifications  and  Procurement 

Military  Specifications 

2.2.1 

•*»> 

Application  and  Feedback 

2.2.2 

High- Volume,  Non-Standard 

2.2.3 

Reliability  £nhancem.ent 

2.2.4 

Component  Procurement  and 
Control  (at  individual  and 
system  level) 

2.1.7,  2,1.8, 

2. 3  (.  -  #1  &  #2) 

Priority 

C 

A 

A 

A 

A 

A 


A 

B 

B 

B 
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CHAPTER  3 

3.0  FABRICATION  PROCESSES  AND  TECHNIQUES 

3.1  OBJECTIVES 

The  specific  objectives  of  this  Chapter  on  Fabrication  Processes  and 
Techniques  are  to  identify  those  aspects  of  semiconductor  component  manufacture 
that  constitute  problem  areas  incorporated  in  the  statement  of  overall  Panel  ob¬ 
jectives  and  to  relate  its  findings  to  those  of  the  other  Chapters  of  this  Report. 

3.2  MANUFACTURING  CONSIDERATIONS 

3.2.1  Device  Fabrication 

The  dramatic  decrease  in  cost  per  function  of  semiconductor  devices 
over  the  years  has  been  paced  by  the  cost  reduction  impact  of  fundamental  under¬ 
standing  of  materials,  processes,  structures  and  production  techniques.  Future 
emphasis  will  shift  away  from  basic  materials  and  structures  to  manufacturing 
control,  testing,  and  quality  and  reliability  assurance. 

Some  important  material-structure  challenges  worthy  of  fundamental 
investigation  remain,  particularly  as  they  relate  to  more  complex  devices  with 
advanced  performance  which  are  being  developed.  Recommendations  are  made 
in  Section  3.3. 1  for  the  following  categories; 

.  crystal  defects. 

.  metallization 

.  bonding. 

.  plastic  encapsulation. 

.  hermetic  packaging. 

3.2.2.  Cost 

The  selling  price  of  semiconductor  components  for  consumer /in¬ 
dustrial  applicaH.on  has  continuously  dropped  during  the  aast  fifteen  years  to  the 
point  where  prices  are  so  low  that  se  veral  major  companies  have  gone  out  of  the 
semiconductor  business  for  lack  of  profit.  Most  devices  and  integrated  circuits 
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sell  for  less  than  a  dollar,  many  for  a  few  cents.  Hence,  it  cannot  be  argfued  that 
semiconductor  components  are  too  e3q)en8ive.  In  addition,  general  reliability  has 
proven  to  be  very  high  based  on  experience  data  over  a  period  of  many  years. 

Quality  problems  have  generally  been  worked  out  between  supplier  and  user, 
frequently  resulting  in  improved  components  and  end  products,  F.eplacement  of 
semiconductor  devices  in  consume r/indus trial  products  is  relatively  easy.  How¬ 
ever,  for  high  reliability  (hi-rel)  application,  there  is  the  added  requirement  of  proof 
of  reliability  before  use.  This  is  where  the  additional  (and  appreciable)  cost  of  hi- 
rel  components  originates. 

The  large  price  differential  between  consumer/industrial  and  hi-rel 
parts  provides  a  temptation  for  equipment  manufacturers  to  use  the  cheaper  units. 

A  more  difficult  problem  is  the  construction  of  equipment  that  does  not  perform 
reliably  even  though  hi-rel  parts  are  used;  in  other  words,  some  hi-rel  components 
are  not  sufficiently  reliable,  or  failures  have  occurred  because  of  poor  application. 
Both  reliability  procedures  and  procurement  procedures  contribute  to  the  problem. 
These  are  discussed  in  the  following  sections;  conclusions  are  based  on  information 
obtained  from  the  bibliography  (3.4)  and  from  the  experience  available  to  the  Panel. 

3.2.3  Reliability  Procedures 

Various  procedures  have  evolved  with  the  objectives  of:  (a)  determining 
the  reliability  of  a  particular  semiconductor  component,  (b)  removing  the  least  re¬ 
liable  units  from  a  production  distribution,  and  (c)  maintaining  production  of  a  given 
device  at  a  consistent  level  of  reliability.  How  well  these  procedures  work,  and 
which  are  the  most  useful,  are  subjects  of  considerable  debate,  however,  the 
procedures  are  essential  to  the  procurement  of  hi-rel  components  and,  through  the 
application  of  advancements  in  reliability  physics,  they  are  continually  improving. 

3. 2. 3.1  Screening 

Screening  (100%  nondestructive  testing)  is  the  process  of  subjecting 
all  units  of  a  given  production  type  to  a  prescribed  series  of  tests,  the  objective 
of  which  is  to  weed  out  the  components  that  are  malfunctioning  or  have  a  high  prob¬ 
ability  of  exhibiting  unacceptably  low  reliability.  It  is  the  most  commonly  used 
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technique  for  reliability  enhancement.  Screening  is  performed  by  the  manufacturer, 
by  the  user,  or  both.  When  performed  by  the  user,  screening  serves  as  an  incoming 
inspection  to  help  reduce  the  impact  of  a  manufacturer’s  mistakes  or  to  economize 
on  that  part  of  a  manufacturer's  testing  costs  if  he  is  relieved  of  screening  responsi¬ 
bility. 

The  following  observations  can  be  made  based  on  experience  with 
screening  of  semiconductor  components, 

1.  System  reliability  is  higher  using  screened  rather 
than  non-screened  parts  (i.e. ,  hi-rel  parts  are  more 
reliable  than  commercial/industrial  components). 

2.  In  general  it  is  cheaper  to  employ  initial  screens 
rather  than  utilize  non-screened  components  and 
then  perform  equipment  fixes.  Equipment  procure¬ 
ment  costs  can  be  identified,  but  costs  of  reliability 
"retrofit"  can  be  unattainable. 

3.  Parts  cost  is  about  10%  of  the  first  cost  of  a  system 
Screening  can  add  appreciably  to  component  costs, 
but  not  significantly  to  a  system’s  first  cost. 

4.  Some  screening  tests  are  common  to  all  components, 
others  may  be  unique  to  a  particular  device  ot  inte¬ 
grated  circuit.  Screening  approaches  used  on  dis¬ 
crete  devices  may  not  apply  to  integrated  circuits. 

5.  There  may  be  differences  in  the  results  of  suppliers 
and  users  ruiming  the  same  screens. 

6.  There  are  cases  where  serious  doubt  exists  that 
the  manufacturer  performed  all  required  screening 
tests  due  to  incomplete  lot  history  data. 
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7.  For  most  effective  use  of  screening  procedures, 
there  must  be  close  customer-vendor  interaction  and 
information  feedback. 

8.  If  screening  r  ^quirements  are  too  rigorous,  many 
good  units  will  be  discarded  resulting  in  low  yield 
and  high  cost. 

9.  A  particular  screening  procedure  may  be  non¬ 
destructive  for  some  components,  and  may  be 
destructive  or  detrimental  to  the  reliability  of 
others. 

10.  Some  failure  modes  are  screened  by  standard 
techniques;  other  failure  modes  are  only 
occasionally  detected. 

11.  Advanced  techniques  (e.g.,  scanning  electron 
microscope  inspection)  are  being  applied  to 
screening.  They  must  be  properly  applied 
for  effectiveness  and  economy. 

3.2.  3.2  High-Reliability  Considerations 

For  highest  reliability,  screening  (100%  nondestructive  testing) 
is  not  sufficient.  As  is  commonly  stated,  "high  reliability  must  be  designed  in, 
not  tested  in. "  The  simple  reason  for  this  is  that  we  know  how  to  screen  for 
some  failure  modes  but  not  for  others.  Certainly,  as  the  field  of  reliability 
physics  advances,  we  learn  more  about  failure  mechanisms  which  allows  the 
establishment  of  more  effective  screens.  However,  the  time  when  screening 
alone  will  serve  to  eliminate  all  potential  failures  will  probably  never  come. 


!■  y, 
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The  basic  concept  for  higb-reliabiiity  assurance  consists  of  100% 
screening  plus  sample  destructive  testing  of  each  production  lot.  All  failures  are 
analyzed  for  failure  mode,  and  grouped.  A  lot  is  accepted  or  rejected  on  the  basis 
of  either  the  number  of  failures,  or  the  character  of  the  failures;  i.  e. ,  whether  they 
are  screenable  as  opposed  to  noa-screenable  (insidious  and  long-time  dependent). 

Lessons  learned  from  high  reliability  efforts  leads  to  the  following 
list  (not  necessarily  complete) : 

1.  Proper  failure  analysis  and  reporting  are  an  essential 
aspect  of  the  high  reliability  procedure. 

2.  Failure  mode  analysis  of  integrated  circuits  is  compli¬ 
cated  by  the  fact  that  not  all  component  elements  are 
accessible. 

3.  A  positive  attitude  of  the  supplier  towards  hi-rel 
production  is  important.  Ilis  personnel  must  be 
properly  trained  and  motivated. 

4.  Volume  procurement  is  necessary  for  the  establish¬ 
ment  of  proved  low  failure  rates. 

5.  System  reliability  may  be  enhanced  by  reducing  the 
number  of  different  parts  in  the  system  and  using 
parts  fabricated  by  a  common  technology. 

3. 2. 3. 3  Production  Control;  Line  Certification;  Captive  Line 

The  high-reliability  procedure  (3. 2. 3. 2)  requires  for  its  practical 
implementation  the  knowledge  that  a  production  line  can  be  controlled  to  turn  r  . 
a  consistent  product.  Realizing  that  production  control  is  the  foundation  upon 
which  all  r'^liability  assurance  techniques  must  rest,  large  users  of  semiconductor 
components  for  hi-rel  systems  have  generally  established  two  procedures  for 
guaranteeing  production  control  on  the  lines  that  manufacture  their  products :  line 
certification  and  the  captive  line. 
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1.  Line  certification  requires  that  the  manufacturer  meet 
specific  standards  of  control  and  documentation  on  his 
line,  and  that  the  product  pass  prescribed  screening 
tests.  The  certification  process  is  a  continual  one  to 
guarantee  that  a  line,  once  under  control,  remains  that 
way  or  loses  its  certification. 

2.  The  captive  line  is  a  production  line  on  the  supplier's 
premises  that  is  under  control  of  the  user.  The  user 
may  specify  completely  the  materials,  processes, 
equipment,  procedures,  documentation  and  tests,  and 
inspect  the  line  for  compliance. 

Some  observations  can  be  made  from  experience  with  these  specialized 
production  lines; 

(1)  Critical  production  steps  must  be  kept  constant,  but 
the  system  must  allow  for  modification  to  incorporate 
improvements. 

(2)  Yield  and  reliability  problems  must  be  differer^tiated. 

Sometimes  they  are  related,  sometimes  not. 

(3)  Line  certification  requirements  must  be  effective  and 
economical.  Over-control  can  create  considerable 
expense. 

(4)  Line  certification  requirements  should  accommodate 
different  steps  by  different  manufacturers. 

(5)  Line  certification  requires  periodic  renewal. 

(6;  Government  agency  personnel  at  the  manufacturer’s 
location  serving  as  resident  inspectors  must  be  highly 
qualified.  Often  they  are  not. 
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3. 2. 3. 4  Standard  Parts,  Preferred  Parts,  and  Non-Standard  Parts 

The  high  reliability  procedure  (Section  3. 2. 3. 2)  is  an  effective  way 
to  obtain  reliability  assurance  for  the  semiconductor  component  corny’ ement  of  a 
large  system.  It  is  also  expensive,  and  would  be  prohibitively  so  if  applied  to  a 
small  system. 

A  related  system  has  the  objective  of  obtaining  standard  reliabile 
parts  for  general  use. 

A  standard  part  is  one  that  passes  the  appropriate  set  of  milita  -'v 
specification  tests  (MIL-M-38510  for  integrated  circuits,  MIL-S-19500  Tor  discrete 
devices),  which  include  screening.  A  discrete  device  must  also  have  an  EIA  registra¬ 
tion.  Methods  of  test  for  qualification  are  specified  in  MIL.-STD-833  (integrated 
circuits)  and  MIL-STD-750  (discrete  devices). 

There  is  also  a  list  of  preferred  discrete  devices  (published  in 
MIL-STD-701)  determined  by  a  committee  with  members  representing  the  armed 
services  and  users.  A  semiconductor  component  appearing  on  this  listing,  which 
is  updated  periodically,  may  be  required  for  a  hi-rel  system. 

In  cases  where  an  equipment  manufacturer  wants  to  use  a  component 
that  is  neither  "standard''  nor  "preferred, "  he  may  request  that  it  be  approved  and 
must  supply  supporting  data.  Methods  of  approval  for  the  use  of  non-standard 
parts  are  listed  in  MIL-STD-749B. 

Additional  observations  include: 

(1)  Test  methods  ana  procedures  do  not  exist  for  newer 
items  (e.g. ,  Metal-Oxide  Semiconductors  (MOS), 

Large  Scale  Integrated  Circuits  (LSI)). 

(2)  A  non-standard  part  is  used  either  by  testing  the  lot  to 
a  procurement  specification  together  with  the  issuance 
by  the  producer  of  a  certificate  of  compliance,  or  by  a 
waiver  of  the  specification  requirements. 
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(3)  A  non-standard  part  may  be  a  standard  part  changed 
slightly  so  the  manufacturer  will  not  have  to  perform 
some  of  the  tests  required  for  the  standard  part. 

3. 2. 3. 5  Failure  Analysis  and  Documentation 

The  key  to  any  successful  program  in  reliability  is  detailed  failurt 
analysis  with  satisfactory  documentation. 

(1)  In  general,  documentation  of  failure  has  been  in¬ 
complete,  failure  analysis  is  incomplete,  and  in¬ 
formation  fragmented  or  missing.  Up  to  now,  the 
best  documentation  has  been  done  by  NASA. 

(2)  Each  failu^  j  should  be  related  to  a  responsible 
manufacturing  process  where  applicable. 

(3)  Failures  may  be  induced  in  many  ways,  such  as 
overstress  in  testing,  mechanical  mishandling  and 
misapplication  (e.g, ,  noise  pulses  in  a  system  power 
supply).  They  may  also  be  inherent  in  the  component. 

(4)  Realistic  documentation  of  failures  may  be  hindered 

f 

by  company  proprietary  considerations. 

(5)  Reliability  problems  with  the  highest  frequency  occur 
prior  to  equipment  reaching  operational  status. 

3.2.4  Procurement  Procedures 

Procurement  procedures  can  contribute  to  problems  in  system 
reliability  in  various  ways.  In  many  cases,  after  a  problem  has  been  identified, 
it  can  be  concluded  that  if  procurement  had  proceeded  as  it  should  have,  the  problem 
would  not  have  occurred.  The  usual  reason  for  procurement  procedural  relaxation 
is  schedule  constraint.  Tliis  leads  many  people  to  ask  the  old  question:  "Why  is 
there  never  time  to  do  it  right,  but  always  time  to  do  it  over?" 
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This  Panel  notes  certain  procurement  practices: 

(1)  Because  of  time  and/or  monetary  problems,  specifi¬ 
cation  requirements  are  often  waived. 

(2)  Prime  contractors  do  not,  but  should,  include  the  cost 

of  assuring  that  suppliers  comply  with  all  quality  require¬ 
ments  of  the  prime  contract  in  their  budget  or  cost 
estimates. 

(3)  Competitive  bidding  to  obtain  systems  contracts  may 
force  bidders  to  relax  reliability  requirements  to  cut 
costs  in  order  to  get  the  business. 

(4)  Competitive  bidding  for  components  by  systems  con¬ 
tractors  tempts  component  manufacturers  to  shortcut 
screening  tests  to  reduce  costs. 

(5)  Vendor-to-vendor  intercliangeability  is  often  non¬ 
existent. 

(6)  Since  offshore  labor  is  less  expensive,  decisions  as 
to  the  amount  of  control  to  be  implemented  are  made 
relative  to  different  cost  factors.  Extra  control  can 
be  more  cost-effective  offshore  than  in  the  U.  S. 

(7)  Established  procurement  procedures  are  not  followed 
in  many  cases. 

3.3  STUDY  TOPICS 

The  following  topics  should  form  the  subjects  of  sponsored  programs 
to  satisfy  the  objectives  of  this  study. 

3.3.1  Specific  Research  Programs 

The  following  areas  would  be  most  fruitful  in  improving  yield  and 
should  be  the  subjects  of  specific  programs  aimed  at  understanding  and  control 
in  a  production  environment. 


3. 3. 1.1 
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Crystal  Defects 

3. 3. 1.1.1  Conclusions 

In  general,  there  exists  an  adequate  supply  of  sufficiently  pure  silicon 
for  the  domestic  manufacture  of  transistors  and  microcircuits  in  the  United  States. 

Crystal  lattice  defects  can  result  in  yield  losses  in  such  large  area 
devices  as  power  transistors  (low  and  high  frequency),  thyristors,  and  complex 
integrated  circuits.  The  role  of  crystal  defects  in  reducing  yield  and  means  by 
which  they  can  be  introduced  during  crystal  growth  and  in  the  manufacturing  process 
is  not  well  understood. 

3. 3. 1.1. 2  Recommendation 

Support  a  program  to  determine  the  fundamental  processes  by  which 
crystal  defects  are  initiated,  and  by  which  they  move  and  multiply  in  a  silicon  wafer 
during  processing.  This  program  should  aim  for  the  formulation  of  low  defect 
processing  procedures. 

3. 3. 1.1.3  Anticipated  Benefits 

This  program  should  lead  to  higher  device  yields  with  possibly  greater 
device  uniformity,  thereby  permitting  more  tightly  controlled  device  parameters. 
This,  in  turn,  should  directly  improve  the  margin  of  tolerance  which  can  be  allowed 
in  circuit  designs,  and  lead  to  the  design  of  more  reliable  circuits. 

3. 3. 1.2  Metallization 

3. 3. 1.2.1  Conclusion 

Defects  in  metallized  conductor  paths  in  integrated  circuits  are  a 
significant  contributor  to  decreased  yield  and  poor  reliability.  This  is  especially 
true  when  the  conductors  are  subject  to  thermal  cycling,  high  peak  current  pulses, 
or  tQ  low  level  corrosion.  This  problem  is  greatly  exacerbated  when  conductors  are 
deposited  over  large  steps  on  the  insulator  surface,  and  when  they  contact  very 
shallow  p-n  junctions.  In  particular,  problems  of  mei  llization  have  slowed  progress 
in  complex  large  scale  integration,  where  two  or  more  metal  layers  are  highly 
desirable. 
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S.  0.1. 2.  2  Re  commendation 

A  program  should  be  instituted  which; 

.  Identifie.';  the  fsondamental  failure  modes  that  are  present 
in  various  metal  systems,  for  a  variety  of  high  stress 
conditions,  e.g, ,  high  current  density ,  large  steps  in 
the  underlying  or  overlaying  dielectric  insulator,  tem- 
perature-power-eurrent  cycling,  etc. 

.  Pevelops  quantitatively  controllable  procedures  by 

which  the  risk  of  these  failure  modes  can  be  minimized. 

,  Transfers  these  procedures  to  actual  manufacturing 
practices  with  the  assurance  that  benefits  of  this  work 
will  be  achieved  in  an  ongoing  manner. 

3.3.  i.  2. 3  Anticipated  Benefits 

It  would  be  expected  that  there  would  ensue  enhanced  reliability  and 
more  effective  reliability  assurance  as  well  as  higher  yield  or  large  scale  inte¬ 
grated  circuits. 

3.3.1. 3  Bonding 

3. 3. 1.3.1  Couclusion 

Both  die  and  wire  bonds  are  primary  areas  for  failure  of  semiconduc¬ 
tor  devices  and  integrated  circuits.  *  We  expect  that  both  the, chip  size  as  well  as 
the  number  of  terminal  pads  will  increase  in  the  future,  due  to  the  increasing  need 
for  complex  large  scale  integrated  circuits.  Hence  these  problem  areas  can  be  ex¬ 
pected  to  become  more  serious. 

3. 3. 1. 3. 2  Recommendation 

A  program  should  be  developed  to: 

.  Study  the  basic  meclianisms  for  quantitative  understanding 
of  die  and  wire  bonding. 

*  cf.  National  Bureau  of  Standards  Technical  News  Bulletin,  October,  1971, 
pp.  248  ff,  for  an  excellent  brief,  but  thorough,  discussion. 
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.  Explore  new  metallurgical  syetems  for  these 
functions. 

.  Explore  new  bonding  systems  which  will  eliminate 
or  reduce  the  lack  of  control  now'  inherent  in  present 
systems. 

.  Develop  methods  for  evaluatir^  the  quality  of  bonds, 
preferably  in  a  non-destructive  manner. 

3. 3. 1.3.3  Anticipated  Benefits 

Enhanced  reliability  and  more  effective  reliability  assurance 
would  be  anticipated. 

3. 3. 1.4  Plastic  Encapsulation 

3.3. 1.4. 1  Conclusion 

Economic  pressures  are  leading  to  a  growing  use  of  plastic  en¬ 
capsulated  semiconductor  components,  integrated  circuits  in  particular.  Plastic 
encapsulated  consumer  and  industrial  devices  have  proven  performance  records. 

The  same  can  be  said  for  their  usage  in  military  fuzes.  It  is  economically  de¬ 
sirable  that  plastic  encapsulation  be  incorporated  more  generally  into  military 
systems.  Unfortunately,  polymers  for  this  application  are  poorly  characterized 
and  specified.  There  is  consequently,  considerable  variation  in  available  polymeric 
products  and  in  the'-r  processing  technique®.  Thus,  they  exhibit  variable  reliability 
performance  under  military  environments. 

3c  3. 1,4. 2  Recommendation 

A  program  should  be  funded  to  study  the  various  classes  of  plastic 
enoapsulants,  the  basic  mechanisms  by  which  these  are  polymerized  during  en¬ 
capsulation,  and  their  basic  properties  which  relate  to  reliable  encapsulation. 
Valuable  results  of  this  program  would  be  the  development  of  precise  means  for 
specifying  the  formulation  for  these  encapsulants  and  the  details  of  the  encapsulation 
process  so  that  highly  predictable  results  could  be  obtained.  In  addition,  the  study 
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should  focus  attention  on  appropriate  testing  screens  for  plastic  encapsulated  semi¬ 
conductor  components. 

3.3. 1.4. 3  Anticipated  Benefits 

The  plastic  package  promises  to  be  an  important  approach  for  reducing 
costs  of  components.  This  cost  saving  can  be  applied  to  government  systems  pro¬ 
vided  adequate  reliability  and  quality  assurance  can  be  demonstrated. 

3.3. 1.5  Hermetic  Packaging 

3. 3. 1.5.1  Conclusion 

Presently  hermetic  encapsulation  is  used  for  most  military  transis¬ 
tors  and  microcircuits  -  the  primary  exception  being  in  weapon  fuzes  where  plastic 
encapsulated  parts  are  used  almost  exclusively.  The  reliability  of  hermetic  pack¬ 
aging  is  a  function  of  many  factors: 

Contamination  that  is  present  within  the  package  before 
lidding  (organic  matter,  metallic  particles,  etc.). 

Sealing  contamination  (such  as  solder  balls  which  fall 
into  the  package  due  to  an  excess  of  solder  during  the 
sealing  operation. 

Contamination  entering  through  voids  in  improperly  formed 
seals. 

All  of  these  forms  of  contamination  can  result  in  long  term  failure. 

3. 3. 1.5. 2  Recommendation 

A  program  should  be  instituted  to  characterize  the  seal  on  the  hermetic 
package,  to  evolve  better  hermeticity  tests,  and  to  develop  techniques  by  which 
large  area  seals  can  be  formed  with  integrity.  Better  techniques  for  detecting  and 
eliminating  contaminants  that  get  sealed  within  the  package  should  be  an  objective 
of  this  program.  In  addition,  new  ways  of  sealing  the  microcircuit  at  the  chip 
level  should  be  investigated,  with  a  view  towards  reducing  the  effects  of  contamina¬ 
tion  and  improper  hermetic  encapsulation. 
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3.3. 1.5,3  Anticipated  Benefit 

Enhanced  reliability  and  more  effective  reliability  assurance  would  be 

anticipated. 

3.3,2  Procurement 

3. 3.2.1  Conclusions 

Procurement  practices  contribute  in  a  major  way  to  the  problems  en- 

counte'*f‘J  by  the  U.  S.  Government  in  obtaining  reliable,  economical  systems 

(3. 2. 4).  Modernization  of  procurement  procedures  should  bu  done, 

3. 3. 2. 2  Recommendations 

.  Sponsor  a  program  to  compile  a  listing  of  the  various 
agencies,  documents,  procedures,  and  reports  relating 
to  the  procurement  of  high  reliability  semiconductor 
components. 

,  Study  and  report  the  economics  of  hi-rel  component 
procurement  as  it  relates  to  system  cost  and  perfor¬ 
mance  to  ascertain  what  first  cost  for  components 
would  make  economic  sense. 

.  Report  on  the  practices  of  competitive  bidding  as  they 
affect  the  ability  of  the  system  manufacturer  to  use 
the  best  techniques  for  hi-rel  assurance. 

.  Study  the  economic  problems  of  line  certification  as 
they  relate  to  volume  of  production. 

.  Recommend  ways  in  which  production  control  may  be 
more  effectively  implemented  and  documented. 

.  Study  the  relation  of  failure  analysis  to  specific 
production  processes. 
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2.3  Anticipated  Benefits 

A  better  understanding  of  the  semiconductor  procurement  system 
and  how  it  works  should  be  achieved.  This  should  lead  to  a  basis  for  developing 
an  improved,  integrated  procurement  system  for  all  government  agencies  with 
benefits  of  economy,  reliability  and  scheduling. 

3.3.3  Reliability  Assurance 

3. 3. 3.1  Conclusions 

The  effectiveness  of  reliability  assurance  procedures  is  limited  by 
the  degree  of  our  understanding  of  failure  mechanisms.  Relatively  little  R  &  D 
effort  directly  applied  to  physics  of  failure  has  been  sponsored.  Further  effort  is 
required  to  advance  knowledge  in  the  fields  discussed  under  3. 2. 3  Reliability 
Procedures. 

3. 3. 3. 2  Recommendations 

.  Sponsor  programs  to  establish  more  meaningful  and 
economical  screens  (nondestructive  evaluation)  which 
are  materials/process  oriented  rather  than  component 
oriented. 

.  Evolve  pertinent  high  stress  (destructive)  tests  for 
faster  and  more  accurate  reliabiLty  prediction. 

.  Perform  R  &  D  in  Physics  of  Failure  relating  to  the 
dominant  failure  modes. 

.  Study  new  techniques  for  more  effective  production 
control  of  materials  and  processes. 

.  Evolve  effective  techniques  for  the  economical  re¬ 
liability  assurance  of  low  volume  parts. 

3. 3. 3. 3  Anticipated  Benefits 

A  more  quantitative  understanding  of  failure  mechanisms  pertinent 
to  semiconductor  components  would  lead  to  better  screens,  more  meaningful  in¬ 
terpretation  of  destructive  tests,  and  effective  screens  for  low  volume  parts. 
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3.4 

3.4.1 


GOVERNMENT-INDUSTRY  COMMITTEE  ON  ffiGH-RELIABlLITY 

PROCEDURES 

Conclusions 

Various  government  agencies,  professional  societies  and  semi¬ 


corn  _ctor  component  suppliers  are  working  together  to  establish  hi-rel  procedures 


for  semiconductor  components.  However,  there  is  duplication  of  effort,  lack  of 


coordination  and  self-centered  motivation. 


3.4.2  Recommen  dations 

.  Study  the  'arious  national  and  international  contributions 
to  hi-  rel  procedures. 

.  Institute  a  government-industry  committee  which  will 
extract  meaningful  data  from  past  and  present  hi-rel 
programs;  assist  in  standardization;  promote  the  exchange 
and  dissemination  of  information;  and  implement  mobliza- 
tion  of  the  hi-rel  practices  used  today. 

3. 4. 3  Anticipated  Benefits 

Establishment  of  a  single  government-industry,  committee  to  co¬ 
ordinate  semiconductor  component  hi-rel  activities  on  national  and  international 
bases  will  lead  to  improved  economy  and  effectiveness  of  hi-rel  procedures. 
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CHi^  PTER  4 

4,0  SPECIFICATIONS  AND  STANDARDS 

4.1  INTRODUCTION 

The  semiconductor  industry  has  generated  an  almost  unlimited  variety 
of  device  types,  covering  a  wide  spectrum  of  electrical  and  mechanical  characteris¬ 
tics  and  a  multiplicity  of  application  ambients.  As  a  consequence  it  has  been  ex¬ 
ceedingly  difficult  to  maintain  any  semblance  of  standardization  and  selection  for 
optimum  cost-effectiveness  in  military  applications, 

ine  strong  interactions  between  the  method  of  specification  and  pro¬ 
curement  and  device  performance  yield,  and  cost  make  the  problem  of  particular 
importance.  As  integrated  circuit  cOi^;ploxity  increases,  the  interrelationship 
between  yield  of  component  and  specification  becomes  of  even  greater  significance. 

The  Panel  identified  a  number  of  needs  for  improvement  in  the 
military  specification  and  procurement  function.  There  are  numerous  instances 
today  in  which  the  procurement  procedure  either  is  so  deficient  as  to  allow  for  the 
use  of  improper  devices  in  critical  systems  or  is  so  restrictive  as  to  inhibit  the 
cost  effectiveness  of  the  system,  A  number  of  problem  areas  which  require  im¬ 
provement  are  described  in  the  following  paragraphs, 

4,  2  MIUrARf-SPECIFICATION  RIGIDITY 

4.2.1  Statement  of  Problem 

Military  specifications  are  too  rigid.  Furthermore,  they  do  not  keep 
up  with  the  state  of  the  art.  In  particular,  they  currently  are  not  sufficiently 
specific  to  end-applications.  One  possible  solution  world  be  to  modify  them  for 
classes  of  service, 

4.2.2  Discussion 

Military  specifications  are  too  rigid  in  that  most  adhere  to  a  set 
pattern  based  on  precedent  rather  than  the  needs  of  the  user  or  changes  in  the 
state  of  the  art.  For  example  mechanical,  environmental,  and  life  tests  found  in 
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most  military-semiconductor  and  microcircuit  specifications  are  10-15  years  old. 
There  has  been  no  attempt  to  upgrade  periodically  the  tests  a  i  the  levels  of 
severity  that  should  be  applied. 

On  the  electrical  end,  MIL  specifications  are  written  broadly  because 
in  many  instances  the  device  end-application  is  not  known.  Therefore,  presumably 
to  be  on  the  safe  side  a  host  of  tests  are  included  to  encompass  general-purpose 
applications. 

Another  encumbering  factor  is  that  i..  ^rany  instances  a  specification 
is  broadly  written  to  cover  many  suppliers.  This  weaken?  the  impact  of  the  speci¬ 
fication  and  also  serves  to  preserve  the  weakness  by  requiring  the  many  suppliers 
to  approve  changes. 

In  components  fabricated  by  high-volume  production,  the  government 
must  take  vhe  lead  in  the  area  of  device  specifications  because  any  single  industrial 
contractor  would  not  exert  enough  economic  influence  to  effect  pr..»per  control. 


4.2.3 


4.3 

4.3.1 


Recommendations 

.  Try  to  limit  the  scope  of  specifications  according  to 
classes  of  service. 

.  Supply  standard  specification  formats.  These  would 
be  of  help  to  the  specification  writer.  These  formats 
should  be  living  documents  subject  to  planned  periodic 
change  by  a  group  of  competent  individuals  with  adequate 
device  experience  and  laboratory  back-up  assi  pied  to 
specification  R  &  D. 

APPUCATIQN  AND  USE 

Statement  of  Publem 

There  are  many  factors  influencing  DoD  device  reliability  which  are 


related  not  only  to  device  fabrication  but  also  to  device  integration  and  operation 
in  subsystems  and  systems  operating  in  a  field  environment. 
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4.3.2  Discussion 

DoD  failure  reporting  and  analysis  techniques  are  sporadic.  There  is 
no  good  system  whereby  failed  components  are  returned  to  a  central  establishment 
for  sufficient  failure  analysis.  Some  failure  information  is  reported  to  designers 
from  the  equipment  fabrication  and  shakedown  phases  but  little  or  none  ever  gets 
back  from  the  field.  There  is  a  need  for  a  better  basis  for  relating  failure  to  the 
design  of  the  device,  the  circuit,  the  equipment,or  the  fabrication  process. 

The  concept  of  life-cycle  cost  must  be  implemented.  All  too  often  the 
reliability  of  the  equipment  is  sacrificed  to  minimize  first  costs.  Reasonable  trade¬ 
offs  must  be  established  to  choose  the  proper  first  cost-reliability  balance,  thereby 
maximizing  yield. 

4.3.3  Recommendations 

.  One  organization  should  supply  competent  support  to 
assure  that  no  interface  problems  arise  during  the 
application  of  devices  to  circuits  and  from  circuits 
to  higher  levels  of  integration.  Standard  procedures 
must  be  developed  to  enhance  the  smooth  integration 
of  these  parts. 

.  A  practical  system  should  be  developed  whereby  timely 
feedback  to  the  device  designer  is  obtained  from 
the  equipment  developers  and  users  so  that  de¬ 
ficiencies  in  device  design  and  fabrication  can  be 
rectified. 

4.4  HIGH-VOLUME  STANDARDS 

4.4.1  Statement  of  Problem 

It  has  been  stated  that,  in  order  to  increase  reliability,  devices  used 
in  government  equipment  should  be  related  to  high-volume  production  types.  If 
production  is  not  at  a  sufficient  level  for  specific  military  requirement,  the  com¬ 
mercial  specifications  should  be  used  for  this  application  alone,  if  possible,  to 
satisfy  the  military  device  requirements. 
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4. 4. 2  Discussion 

Some  of  the  advantages  that  may  be  attributed  to  the  use  of  high- 
volume  production  devices  are  as  follows: 

Significantly  lower  prices  are  attainable  due  to  higher  yield  and 
to  economies  of  scale  associated  with  liquidating  development, 
setup,  tooling  and  test  equipment  costs  over  a  large  base. 

Commercial  field  experience  is  often  available  for  use  by 
gc^'ernment  designers  and  purchasers  in  evaluating  the  risk 
of  using  commercial  components.  This  engenders  competition 
between  would-be  suppliers  and  assures  multiple  sources  of 
supply. 

Some  of  the  disadvantages  that  may  be  cited  for  the  use  of  high- 
volume  commercial  components  are: 

In  order  to  qualify  for  military  use,  commercial  production 
lines  may  require  costly  special  design  at  both  equipment 
and  component  levels.  They  may  require  the  implementation 
of  special  screening  procedures  to  assure  compliance  with 
more  stringent  military  envi  ronmental  requirements.  These 
offset  the  potential  cost  advantage  of  the  high-volume  base. 

Large-scale  integrated  circuits  are  considerably  more  specialized 
than  uevices  of  lower  integration  levels.  Consequently,  any 
policy  designed  to  encourage  the  use  of  primarily  commercially 
available  integrated  circuits  could  adversely  limit  the 
choices  available  to  equipment  designers  and  could  also 
discourage  future  development  of  important  large-scale 
integrated  circuits. 
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The  issue  of  standard,  high-volume  components  versus  custom-designed 
parts  is  not  an  easy  one  to  resolve  without  further  research  and  experience  relating 
to  specific  cases.  The  introduction  of  integrated  circuits  in  government  equipment 
involves  reliability  risks  at  both  the  component  and  equipment  levels.  Whenever  new 
processes  are  employed  or  new  components  are  manufactured  a  learning  period  is 
encountered  after  the  change  of  the  manufacturing  line.  Once  the  learning  interval 
has  been  passed,  the  line  should  be  kept  in  operation  in  order  to  maintain  high-yield 
performance.  This  is  only  practical  if  high-volume  usage  of  the  components  exists. 
Custom  devices  having  limited  volume  potential  must  bear  a  commensurate  cost  per 
unit  and  this  additional  cost  must  be  reincurred  whenever  the  line  is  restarted  after 
an  appreciable  idle  interval. 

The  use  of  high-volume  commercial  integrated  circuits  in  military 
equipment  is  not  without  additional  risk  as  to  cost  and  reliability.  Data  have  been 
accumulated  that  show  that  all  complex  electronic  equipments  go  through  a  shake- 
down  phase  before  desired  reliability  is  achieved.  ♦  It  is  an  open  question  whether 
equipment  reliability  improvement  will  be  less  costly  when  high-volume  commercial 
components  are  used  rather  than  custom-designed  components. 

4.4.3  Recommendation 

Research  and  development  programs  should  be  undertaken  to  assess 
the  cost-effectiveness  of  using  standard,  commercially  available  components, 
particularly  large-scale  integrated  semiconductors,  in  different  generic  classes  of 
equipment. 

4. 5  EFFECT  ON  YIELD  OF  EQUIPMENT  REU.ABILITY  ENHANCEMENT 

4. 5. 1  Statement  of  Problem 

On  occasion,  the  prediction  and  enhancement  of  eqiu^  ent  reliability 
hfis  been  an  R  &  D  activity;  and ,  thus,  involved  the  services  of  si  scientific 
and  engineering  personnel.  Generally,  however,  achievement  of  high  reliability 


*  J,.  D.  Selby  and  S.  G.  Miller,  "Reliability  Planning  and  Management  (rpm)" 
Paper  presented  at  ASQC/SRE  Seminar,  Niagara  Falls,  New  York  9/26/70. 
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has  not  been  given  sufficient  priority  during  device,  equipment,  or  system  develop¬ 
ment.  In  the  Apollo  Program,  reliability  prediction,  enhancement,  and  implemen¬ 
tation  was  made  the  specific  responsibility  of  a  major  subcontractor.  As  a  result, 
hitherto  unprecedented  levels  of  system  reliability  were  attained.  In  the  past  it  has 
not  generally  been  considered  practical  for  economic  reasons  to  achieve  this  high 
level  of  reliability  in  quantity -produced  military  devices  and  equipment.  Reliability 
enhancement  turns  out  to  be  principally  a  part  of  the  manufacturing  phase  of  equip¬ 
ment  procurement.  Consequently  it  may  not  receive  adequate  attention  from  persons 
wdth  appropriate  levels  of  competence.  Moreover,  a  substantial  effort  to  materially 
improve  device,  equipment  and  system  performance  or  reduce  equipment  downtime, 
(and  thereby  greatly  extend  system  operating  life  between  overhauls)  is  seldom  part 
of  a  procurement  contract.  Yet  a  significant  increase  in  the  field  life  of  equipment 
between  overhauls  should  be  an  easily  attainable  goal. 

4.5.2  Discussion 

There  is  a  widespread  tendency  to  procure  devices  and  equipment  on  a 
lowest-cost  basis,  which  is  understandable  and  proper,  otter  factors  being  equal. 
Unfortunately,  the  reflection  of  costs  for  reliability  improvement  works  to  the  dis¬ 
service  of  those  manufaciurers  diligent  in  reliability  upgrading.  Although  there  is 
no  guarantee  that  expensi’.-'  devices  or  equipments  are  better  than  less  costly  p  j~ 
ducts  of  the  same  kinds,  it  is  important  to  recognize  that  reliability  and  performance 
of  a  high  order  are  apt  to  be  expensive  and  will  tend  to  increase  procurement  costs. 
On  the  other  hand,  failure  to  make  reliability  a  prime  consideration  may  result  in 
costs  beyond  measurement,  e.g. ,  as  in  an  aborted  or  failed  mission. 

The  Panel  recommends  that  manufacturing  contracts  generally  include 
funds  eiv "marked  for  reliability  prediction  and  enhancement.  This  allocation  should 
cover  the  .;osts  of  performing  a  contractual  commitment  by  the  manufacturer  to 
obtain  performance  and  failure  data  from  the  field  and  to  utilize  such  data  for 
the  improvement  of  product  reliability.  Such  activities  should  be  monitored 
by  the  personnel  responsible  for  the  original  development  or  procurement. 

Follow-on  orders  for  additional  devices,  equipment,  or  systems. 
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should  be  contingent  upon  the  timely  introduction  of  improvements  derived  from 
such  reliability  monitoring  programs. 

4. 5. 3  Re  commendations 

.  Device,  equipment,  and  system  reliability  enhance¬ 
ment  should  be  recognized  and  documented  as  an 
essential  activity  by  both  supplier  and  user. 

.  Reliability-enhancement  functions  should  be  per¬ 
formed  by  highly  qualified  personnel. 

.  The  enhancement  of  the  reliability  of  devices, 
equipment,  and  systems  should  be  a  contractual 
part  of  the  procurement. 

.  Field  experience  should  be  introduced  into  the 
procurement  process  with  the  aim  of  upgrading 
equipment  or  system  reliability  through  the 
duty  life  cycle. 

.  Follow-on  orders  should  require  developmental  im¬ 
provements  based  on  field  performance  and 
reliability  data. 

4,  6  SCREENJJ^G  AND  BURN-IN 

4-6.1  Statement  of  Problem 

The  mode  and  utility  of  screening  and  bum-in  applied  to  military 
devices  and  subsystems  have  been  debated.  The  DoD  position  relative  to  general 
application  of  screening  and  b!im-in  is  not  clear. 

4,6.2  Discussion 

Screening  (nondestructive  evaluation)  and  bum-in  (operation  at  rated 
parameters  for  a  stated  period  of  time),  as  used  here,  are  not  meant  to 
stress  devices  and  subsystems  beyond  rated  conditions. 
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Screening  and  burn-in  at  both  the  device  and  subsystem  levels  have 
proven  useful.  If  these  tecliniques  are  effective  in  screening  out  early  defectives, 
they  should  be  made  mandatory  on  all  components  and  subsystems  procured  by  DoD. 

At  present,  the  preconditioning  sequence  to  screening  and  burn-in 
is  a  fixed  pattern  of  tests  for  all  detail  specificaticns  based  on  test  methods  in 
MIL-STD-750  and  ML-STD-883. 

4.6.3  Recommendatioa 

Device  and  subsystem  screening  and  burn-in  should  be  studied  as 
techniques  for  enhancing  system  yield  and  cost  effectiveness. 

4.7  DEVICE  INTERCHANGEABILITY 

4.7.1  Statement  of  Problem 

Interchangeability  of  solid-state  devices  from  different  vendors  is 
difficult  due  to  variations  in  the  design  of  the  devices.  This  situation  will  probably 
worsen  with  the  increasing  complexity  of  integrated  circuits. 

4.7.2  Discussion 

The  principal  reason  given  for  the  interchangeability  problem  is  that 
component  spjcifi cations  tend  to  be  overly  oriented  to  vendor  practices  at  the  ex¬ 
pense  of  user  needs. 

In  many  cases,  the  specifications  are  inadequate  to  ensure  inter¬ 
changeability  of  components.  Some  of  the  cited  specification  deficiencies  are 
as  follows: 

Parameters  com.  lonly  accepted  by  various  vendors  tend 
to  be  included,  ignoring  others  that  are  required  but 
cannot  be  agreed  upon  between  competing  vendors.  Thus, 
many  specifications  are  incomplete. 

Specification  limits  are  often  deliberately  ividcnsd  in  order 
to  obtain  greater  yield  from  a  given  vendor,  to  accommodate 
process  differences  between  vendors,  or  to  reduce  the  cost 
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of  testicg.  A  reliability  price  is  exacted  for  such  in¬ 
creased  tolerances,  because  of  either  greater  power  dissipa¬ 
tion  within  the  circuit  or  reduced  parametric  margins  in 
the  functional  circuit. 

The  interchangeability  problem  becomes  consider  ably  more  complex 
in  the  transition  from  discrete  to  integrated  components.  The  two  major  reasons 
for  this  added  complexity  are: 

There  is  a  recondite  and  complex  relationship,  some¬ 
times  not  yet  analyzed,  between  individual  element 
characteristics  and  circuit  performance  as  measured 
at  the  terminals. 

Some  important  properties  of  an  integrated  circuit  may 
not  be  testable  except  under  end-use  conditions  due  to  the 
large  number  of  combinations  of  possible  but  unanticipated 
parasitic  effects. 

4.7.3  Recommendation 

Specifications  of  integrated  circuits  should  be  based  upon  generic-use 
classes  anf  oriented  to  the  specifications  of  the  user  instead  of  the  vendor. 
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CHAPTER  5 

5. 0  SYSTEMS  APPUCATIQNS  AND  USE  * 

5.1  INTRODUCTION 

In  Systems  Applications  and  Use,  the  Pane)  focused  its  attention  on 
the  interaction  between  systems  applications  and  the  teclmical  and  economic 
factors  involved  in  the  procurement  and  production  of  microelectronic  devices. 

The  factors  studied  from  a  system  point  of  view  include: 

System  mission  as  related  to  cost-reliability  tradeoff 
System-design  considerations 
Production  and  process  controls 
Specifications  and  standards 

Qualification,  screening,  and  acceptance  procedures 
Failure-analysis  techniques  and  procedures 
Procurement  procedures  and  economic  factors 

5.2  BACKGROUND 

5.2.1  Scope  of  Study 

The  past  two  decades  have  seen  microelectronic  technology  grow  from 
the  laboratory  to  widespread  applications  in  the  full  spectrum  of  electronic  equip¬ 
ment  employed  by  all  the  military  services  and  NASA.  These  applications  range 
from  relatively  straightforward  types  like  the  mass-produced  mobile  radio  sets, 
utilizing  off-the-shelf  military-grade  components,  to  highly  sophisticated,  low-volume 
missile,  spacecraft,  and  aircraft  subsystems  wherein  many  of  the  individual  com¬ 
ponents  are  custom  designed,  the  manufacturing  and  testing  processes  scrupu¬ 
lously  controlled,  and  system  failure  is  considered  catastrophic.  The  principal 
differences  between  the  two  extremes  stem  from  economic  factors  that  are  strongly 
influenced  by  considerations  of  mission  criticality,  whether  or  not  human  life  is  at 

stake,  maintenance  philosophy,  and  ultimately  the  cost  and  prestige  implications 
♦Consulting  and  editorial  support  for  this  Chapter,  provided  by  Mr.  W.  J.  Aston  of 
the  Aerospace  Corporation,  is  acknowledged  with  thanks. 
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of  fMlure.  It  was  felt  that  any  problems  associated  with  the  equipment  on  ihe 
lower  end  of  the  criticality  scale  (characterized  by  expected  failures  as  reflected 
in  MTBF  calculations)  were  essentially  traceable  to  the  adequacy  of  existing 
component  standards  and  specifications;  these  aspects  have  been  treated  in  the 
chapter  on  Specifications  and  Standards.  On  the  other  hand,  the  Panel  felt  that 
the  systems  on  the  high  end  of  the  mission  criticality  scale,  (characterized  by 
the  goal  of  zero  failures)  and  perhaps  most  of  the  systems  lying  between  the  two 
extremes  represented  a  significant  pimblem  area  to  be  studied  from  a  systems  ap¬ 
plications  point  of  view.  To  this  end,  several  major  mission  critical  systems 
were  investigated.  The  aim  was  to  identify  any  specialized  techniques,  including 
novel  technical  and  management  approaches,  that  had  been  successful  in  achieving 
a  much  higher  level  of  reliability  than  had  been  achieved  in  the  other  like  systems. 

5.2  2  Areas  of  Investigation 

It  was  felt  that  examining  the  experience  of  several  relevant  major 
programs  would  be  an  effective  way  to  study  the  problems  of  microelectronic  ap¬ 
plications  to  large  systems  and  to  learn  of  the  various  techniques  used  to  ensure  Mgh 
reliability  in  these  applications.  Interviews  were  held  with  key  t:  .-vernment  and 
contractor  personnel  familiar  with  the  incorporation  of  microeietironics  in  the 
Apoilo,  Poseidon*  Mariner,  F-111  aircraft,  Defense  Support  Satellite,  and  the 
AN/FYQ-47  Common  Digi/'zer  data-processing-system  programs.  While  there 
exist  a  number  of  specifications,  standards,  technical  reports,  and  procedures  speci¬ 
fically  dedicated  to  semiconductor  and  microelectronic  components,  it  is  also  clear 
that  merely  using  the  military  specifications  in  the  placing  of  purchase  orders  is 
no  guarantee  of  being  able  to  consistently  obtain  devices  of  the  quality  and  reliability 
specified.  It  is  significant  that  many  of  these  programs  deemed  it  necessary  to 
employ  program  management  actions  that  worked  outside  of  and  beyond  the  standard 
procedures.  Many  of  the  methods  used  were  quite  similar  in  intent,  but  varied  con¬ 
siderably  in  technique  and  implementation. 
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The  Apoilo  program,  for  example,  is  widely  recognized  as  a  plateau 
in  man's  quest  for  technological  systems  superiority  and  is  held  as  a  considerable 
achievement  in  system  reliability  from  which  all  other  equipment  development  can 
now  benefit.  (Two  case  histories  that  illustrate  the  techniques  used  and  benefits 
derived  from  planned  integrated  circuit  high  reliability  in  the  Apollo  Program  are 

(lU 

the  paper  prepared  for  this  Panel  by  C.  J.  Godwin  of  the  MITRE  Corporation  ' 

(2) 

and  the  soon  to  be  published  paper  by  E.  C.  Hall  of  M.I,  T.  ) 

It  should  be  remembered  that  the  Apollo  program  received  very  high 
national  priority,  ample  funding,  and  close  to  a  decade  in  which  to  achieve  opera¬ 
tional  capability.  These  factors  do  not  c  iminish  the  significance  of  the  Apollo 
achievement,  but,  when  contrasted  to  ty  ncal  military  systems  procurement,  offer 
some  cogent  reasons  for  NASA's  decision  to  adopt  a  parts  development  and  qualifi¬ 
cation  process  tailored  to  its  specific  reliability  needs.  Th ;  military  services,  on 
the  other  hand,  typically  employ  parts-development  and  qualification  procedures 
that  were  created  to  satisfy  the  needs  of  the  previous  technological  generation  of 
military  systems  rather  than  today's  technology. 

Current  pracf  ;e  in  the  DoD  seems  to  substantiate  the  widely  held 
viewpoint  that  not  all  programs  can  enjoy  the  same  level  of  mission  criticality  or 
justify  similar  investment  in  component  development  or  manufacturing  techniques 
needed  to  attain  a  very  high  level  of  electronic  reliability.  Factors  such  as  miction 
function  and  priority,  available  funding,  operational  safety,  environmental  require¬ 
ments,  and  maintainability  all  influence  the  consideration  of  reliability-cost  trade¬ 
offs  at  the  system  level,  but  exceptions  occur.  Thus,  one  finds  select  missile 
and  space  programs  insisting  upon  the  development  and  production  of  high- reliability 
electronic  components  while  other  DoD  programs  continue  to  struggle  with  field 
failures,  aborted  missions,  extensive  spare  parts  inventories,  shortages  of  skilled 
maintenance  technicians,  etc.  (The  Rome  Air  Development  Center  prepared  for 
the  Panel  a  case  history  of  the  AN/FYQ-47  Common  Digitizer  program^^^  which 
illustrates  the  significance  of  this  problem  and  the  approach  taken  by  the  USAF  and 

FAA  to  achieve  higher  reliability  in  an  advanced  electronic  ground  system). 
♦Superscripts  refer  to  references  in  5.5,  pp.  71,  72. 
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Knowledgeable  people  in  the  DoD  are  deeply  concerned  about  the  impact  of  micro¬ 
electronic  technology',  and  continue  to  seek  assuranc-e  that  higher  reliability  will 
ultiL'ately  low'er  overall  systems  costs  without  penalizing  the  performance  of 
sophisticated  new  military’  systems. 

The  following  comparison  illustrates  the  integrated  circuit  procure¬ 
ment  and  application  methods  employed  by  two  different  kinds  of  programs,  i.e. , 
a  "special"  program  in  which  high  component  reliability  was  needed  to  meet  mission 
requirements,  and  a  "ty’pical"  program  in  which  more  or  less  standard  procedures 
and  practices  were  used. 

Characteristics  cf  Special  Priority  Mission  Reliability 
Program  Versus  Typical  Priority  Mission  Reliability  Program 

Total  Integrated  Circuits  Purchased 
Special:  400,000  units 

Typical;  10,000  units 
Integrated  Circuit  Control 

Special:  Three  circuit  types 

Typical;  Ten  circuit  types 
Integrated  Circuit  Qualification  and  Production  Period 
Special:  Five  years 

Typical:  Two  years 

Procurement  Method 

Special:  a.  Cost-type  development  contract 

b.  Fixed-price  production  contract 
Typical:  Vendor  purchase  order 

Specifications 

Special:  Developed  for  program 

Typical:  Company  preferred-part  specifications 

modified  for  program 
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Vendor  Selection  and  Qualification 


Speciiil:  a.  Pilot  production  runs  from  three  vendors 

under  user  surveillance 

b.  Electrical  and  reliability  testing  of  pilot 


c.  Complete  failure  analysis  and  failure 
mechanism  identification 

Typical:  a.  Electrical  and  physical  test  of  small  sample 

b.  Manufacturing  line  survey 

c.  Review  of  vendor-generated  quiilification 


d.  Competitive  bid 
Vendor  Monitoring  and  Control 

Special:  a.  User  engineers  direct  monitoring  of  inte¬ 

grated  circuit  production  interfacing  with 
vendor  manufacturing  and  engineering 
personnel 

b.  Cooperative  probleih-solving  efforts 
during  course  of  program 

c.  Baseline  process  specification  changes 
controlled  by  user 

Typical:  a.  Defense  Contract  Administration  Services 

or  user  quality  assurance  monitor  lot 
acceptance  testing 

b.  User  engineers  monitor  preseal  visual 
inspection 

c.  Occasional  user  visit  to  vendor  plant, 
generally  contacting  a  marketing  repre¬ 
sentative  ' 
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d.  Vendor  provided  user  with  a  list  of  process 
specifications  and  a  photograph  of  chip  to 
define  circuit 


Typical:  a.  One  hundred  percent  environmental,  elec¬ 

trical,  and  burn-in  testing  based  on  military 
requirements  and  taking  advantage  of  vendor’s 
in-house  testing  system;  lot  acceptance  based 
on  a  percent  defective  allowable  less  than  5% 

b.  Sample  100-hour  life  and  destructive  en¬ 
vironmental  tests  with  lot  acceptance  criteria; 
lot  tolerance  percent  defective  less  than  10% 

c.  Acceptance  testing  done  by  vendor  and 
monitored  by  user  quality  assurance  or 
Defense  Contract  Administration  Services 

The  special  component-reliability  program,  outlined  above,  attained 
failure  rates  of  about  0.003%  per  1000  hours  to  a  90%  confidence  level.  Guidance 
computers  fabricated  using  these  circuits  have  functioned  without  failure  in  numerous 
critical  missions. 
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The  integrated  circuits  procured  by  the  typical  program,  outlined 
above,  caused  circuit  board  failure  during  equipment  build-up.  The  cause  of  the 
problem  was  traced  to  defective  metallization.  All  circuits  were  returned  to  the 
vendor,  who  instituted  a  crash  corrective-action  program  that  was  apparently 
successful  but  could  not  be  completely  evaluated  before  launch.  Specific 
screening  for  the  metallization  problem  was  performed  on  aU  replacement  circuits; 
however,  other  failure  mechanisms  th.it  might  have  been  introduced  by  the 
corrective  action  could  not  be  anticipatei.  The  spacecraft  was  launched  with  a 
calculated  reliability  risk  and  is  functioning  properly,  although  insufficient  opera¬ 
ting  time  has  been  accumulated  at  this  writing  to  verify  system-reliability  objectives. 
The  integrated-circuit  problem  created  serious  project-scheduling  delays,  which 
contributed  heavily  to  a  cost  overrun. 

One  of  the  principal  areas  of  concern  from  a  systems  viewpoint  is  the 
question  of  whether  or  not  the  so-called  high-reliability  techniques  are  cost-effective. 
Another  principal  concern  is  the  degree  to  which  these  techniques  should  be  made 
applicable  to  more,  cr  perhaps  all,  military  electronic  systems.  The  programs 
that  have,  of  necessity,  employed  high-reliability  techniques  seem  to  demonstrate 
amply  that  these  procedures,  when  p''operly  applied,  do,  in  fact,  result  in  an  out¬ 
standing  level  of  reliability.  The  added  increments  of  cost  a.=sociated  therewith 
are  difficult  to  discern  because  of  the  various  types  of  funding  applied  to  the 
several  research,  development,  test,  and  engineering  (RDT&E)  phases  involved, 
and  in  no  case  was  it  apparent  that  the  problem  had  been  approached  from  the 
standpoint  of  evaluating  higher  component-reliability  versus  life-cycle  costs. 

Since  it  appears  that  mission  criticality  is  the  key  in  determining  whether  high- 
reliability  procedures  and  management  techniques  will  be  used,  it  seems  logical 
that  the  DoD  should  re-examine  their  applicability  to  new  military  electronic 
systems. 
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5.3  SUMMARY  OF  FINDINGS 

Examination  of  the  application  of  integrated  circuits  to  the  various 
systems  as  outlined  in  the  previous  section,  coupled  with  the  personal  and  other 
experiences  available  to  Panel  members,  clearly  emphasizes  the  following  two 
factors: 


First,  typical  system  application,  development  and  procure¬ 
ment  procedures  often  result  in  less  than  satisfactory  inte¬ 
grated  circuit  reliability.  Though  the  initial  cost  of  the  in¬ 
tegrated  circuits  may  seem  reasonable,  the  cost,  schedule, 
and  operational  impact  of  failures  at  higher  levels  of 
assembly—or  worse  still,  of  field  failures — leads  one  to 
the  conclusion  that  improved  techniques  must  be  devised 
to  ensure  dependable  high  reliability  at  the  component  level. 

Second,  some  major  critical  programs 
have  developed  effective  techniques  for  the  applicatir  i  of 
integrated  circuits  that  ensure  a  very  high  level  o" 
reliability.  These  techniques  involve  focusing 
management,  engineering,  and  fiscal  attention  on  reliability 
as  a  prime  goal,  a  condition  that  would  be  impossible  to 
achieve  by  the  individual  typical  program  by  usual  current 
practice. 

The  distinction  between  these  two  methods  of  system  development  and 
component  procurement  is  predicated  on  an  implicit  understanding  that  various  levels 
of  criticality  of  mission  function  response  enter  into  system  conception,  design, 
and  acquisition.  This  is  to  say  simply  that  not  all  hardware  or  software  purchased 
for  military  use  is  equally  critical  as  to  end  purpose,  and  therefore  is  not  given  the 
same  level  of  treatment  with  respect  to  component  specification  and  system 
development  priority.  These  factors  reflect  down  to  the  le  ^el  of  and  set  the  philoso¬ 
phy  for  the  procurement  and  incorporation  of  all  electronic  components  used  in  a 
system. 
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This  process  of  grading  or  judging  the  mission  criticality  of  military 
equipment  is  described  here  as  implicit  because  of  the  wide  diversity  of  factors 
that,  in  the  majority  of  systems  programs,  establish  the  requirements  and  the 
actual  program  character  to  obtain  any  particular  level  of  equipment  design  quality 
and  operational  dependability.  Overall  mission  function  aad  the  urgency  for  deploy¬ 
ment  of  a  system  initially  establishes  a  priority  under  which  the  program  enters  the 
design  and  acquisition  cycle.  In  special  programs  (Polaris,  Minuteman,  Apollo), 
the  level  of  funding  and  sustained  urgency  sets  the  program  level  of  effort  from  the 
start  and,  in  such  exceptional  programs,  tends  to  define  more  explicitly  the  quality 
and  reliability  of  electronic  components,  assemblies,  subsystems,  and  systems. 

In  the  large  majority  of  programs,  however,  more  constrained  budgets  and  less 
urgency  are  the  case,  and  the  end  quality  and  dependability  become  largely  dependent 
upon  the  soundness  of  the  program  design  and  its  technological  basis,  the  relative 
allocation  of  funding  within  elements  of  the  program,  the  quality  of  program  manage¬ 
ment,  and  the  capabilities  of  the  contractors  selected  to  do  the  work.  In  the  majority 
of  programs  the  plan  for  component  quality,  reliability,  and  operational  dependability, 
while  possibly  well  conceived  initially,  must  conform  to  rather  rigid  standard 
practices .  Furthermore ,  in  normal  circumstances  only  an  infrequent  effort  can  be  made 
to  draw  up  special  component  snecifications  or  make  special  adjustments.  This  differs 
in  marked  degree  froi  the  case  of  exceptional  mission-critical  programs. 

It  is  clear  that  not  all  programs  can  be  elevated  in  importance  so  as 
to  command  the  funding  and  sustained  effort  in  the  component-acquisition  program 
that  is  put  into  the  few  exceptional  programs.  The  critical  questions  that  arise  are: 
Can  each  individmil  program  apply  at  least  some  of  the 
special  techniques  that  the  exceptional  programs  have  so 
effectively  used  to  ensure  integrated-circuit  reliability  ? 

Can  DoD  as  a  whole  use  its  immense  resources  and  pur¬ 
chasing  power  to  achieve  a  very  high  level  of  reliability 
for  all  critical  programs  without  burdening  each  individual 
program  with  a  high  cost  in  money  and  e^gperienced  taleni 
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usually  not  available  to  the  typical  military  system? 

The  Panel  has  addressed  itself  to  these  questions  and  has  developed 
conclusions  and  recommendations  that  in  some  cases  are  far-reaching  but,  never¬ 
theless,  are  believed  to  be  implementable  and  would  result  in  a  great  improvement 
in  integrated-circuit  jdeld  and  reliability  for  DoD  systems. 

5.4  DISCUSSIONS,  CONCLUSIONS  AND  RECOMMENDATIONS 

In  developing  the  recommendations  two  factors  were  kept  in  mind. 
First,  emphasis  was  placed  on  issues  that  would  impact  the  technology  fabrica¬ 
tion  and  procurement  of  devices  required  in  high-reliability  applications.  Second, 
the  Panel  was  convinced  that  the  problem  of  overall  yield  based  on  reliability  is  a 
serious  one  and  therefore  recommendations  may  have  far-reaching  implications  in 
military  system  design  and  management.  The  intent  of  the  recommendations  is  to 
serve  as  a  goal  and  a  point  of  departure  for  the  conduct  of  a  much  more  detailed 
analysis  of  the  implications  posed  by  the  proposed  solutions  to  this  serious  problem. 


5.4.1  Systems-Applications  Study 

5.4. 1.1  Discussion 

In  light  of  the  liiuited  scope  of  this  study  and  absence  of  certain 
quantitative  analyses  and  detailed  comparisons,  ic  was  the  Panel's  feeling  that  some 
essential  questions,  including  the  following,  required  further  analysis: 

1.  What  is  the  total  annual  dollar  value  of  the  direct 
and  indirect  DoD  and  NASA  microelectronic  pur¬ 
chases  and  what  percentage  is  this  of  the  total  dollar 
volume  of  the  microelectronic  industry  ?  A  breakdown 
of  these  numbers  by  circuit  types,  research  and 
development,  production,  etc. ,  should  prove  useful. 
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2.  For  a  given  number  of  DoD  programs  (perhaps 
ten),  what  is  the  cost  of  the  integrated  circuits 
and  how  does  this  relate  to  the  overall  system 
cost  ? 

3.  For  several  typical  and  special  system-develop¬ 
ment  programs ,  what  are  the  costs  involved  in 
fixing  problems  arising  in  integrated-circuit  ap¬ 
plications  that  develop  during  system  test?  A 
comparison  of  all  relevant  factors  among  these 
programs  should  be  made. 

4.  What  is  the  optimum  way  to  implement  some  or 

all  cf  the  recommendations  gradually  so  as  to  maxi¬ 
mize  the  long-term  advantages  and  minimize  the 
short-term  pitfalls  and  dislocations  that  may  result? 

5. 4. 1.2  Conclusion 

The  Panel  feels  that  an  adequate  study  of  the  above  questions  would 
require  the  attention  of  highly  qualified  and  experienced  individuals  both  in  and  out 
of  government  with  good  judgment  and  a  background  in  both  the  technical  and 
management  areas  of  DoD  systems.  Such  a  group  cf  individuals  could  be  motivated 
to  undertake  a  quantitative  study  of  the  crucial  factors  that  have  been  outlined, 
provided  that  DoD  agrees  on  the  value  and  necessity  of  the  major  thrust  of  the 
recommendations  detailed  below.  The  Panel  feels  that  the  results  of  such  a  study 
will  validate  the  bulk  of  the  recommendations,  but  strongly  urges  an  intensive  in¬ 
vestigation  to  ensure  that  they  are  indeed  valid  and  that  the  mode  of  implementation 
is  the  most  effective. 

5. 4.1. 3  i  Recommendation 

The  DoD  should  establish  a  committee  or  task  group  of  highly  qualified 
and  experienced  individuals,  both  in  and  out  of  government  supported  by  full-time 
professional  staff,  to  study  the  questions  of  5. 4. 1. 1,  assess  their  implications, 
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and  define  options  and  optimum  methods  of  implementation. 

5.4.2  System-Design  Considerations 

5.4. 2.1  Discussion 

Generally,  the  work  in  early  conceptual  design  assumes  that  new 
components  can  be  procured  in  useful  quantities  that  will  show  their  predicted 
performance.  Fabrication  and  production  problems,  and  particularly  the  total 
end  costs  to  obtain  new  components  that  consistently  meet  performance  objectives 
and  that  will  perform  reliably  in  the  system  application,  are  often  not  fully 
appreciated  early  in  a  program’s  design  phase.  Frequently  new  components  are  de¬ 
signed  into  t  ircuits  and  equipment  primarily  on  the  basis  of  needed  performance — 
and  premium  prices  are  paid  for  the  small  quantities.  Only  if  a  problem  as  to 
availability  of  usable  quantities  or  performance  characteristics  arises  is  attention 
really  focused  on  the  component  design  or  on  the  status  of  the  fabrication  processes. 
Yield  and  quality  factors  are  only  of  concern  as  they  may  affect  availability  for 
production  use — not  from  the  standpoint  of  fundamental  quality,  dependability,  and 
and  ultimate  costs  in  end  use.  This  larger  concern  is  deferred  to  later  in  the 
manufacturing,  acceptance,  and  field-testing  phases  and,  as  the  intrinsic  quality  of 

the  components  emerge,  unpleasant  and  costly  experiences  may  often  be  the  lot  of  the 
program. 

While  the  liiscussion  has  generally  considered  current  integrated- 
circui!  technology  along  with  other  types  of  electronic  components,  the  trend  to 
large-scale  integrated  microcircuit  assemblies  will  introduce  special  design 
factors  into  component  procurement.  These  factors  provide  further  pressures  to 
use  a  limited  number  of  circuit  types,  and  can  have  beneficial  effects  in  the  larger 
sense  on  overall  component  standardization  and  quality  and,  ultimately,  in  systems 
reliability. 

Experience  in  the  Apollo  and  other  programs  has  already  shown  that 
the  selection  of  a  few  types  of  components  with  attendant  concentration  on  all  aspects 
of  cheir  development  and  manufacture  can  yield  significant  improvements  in  opera¬ 
tional  dependability. 
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It  is  true  that  the  philosophy  of  limitii^  the  types  of  components  used 
in  system  designs  is  based  on  the  standard-parts  practice  presently  used.  The  re¬ 
sult  of  applying  these  practices  in  military  equipment  design,  however,  has  not 
been  to  limit  the  numbers  of  types  of  components  used,  but  rather  to  set  standards 
on  a  wide  selection  of  components  for  reasons  of  logistics  and  support.  Further, 
so-called  nonstandard  components  are  routinely  incorporated  into  system  designs 

because  of  the  pressures  to  meet  performance  requirements  derived 

(4) 

from  the  system's  mission  requirements. 

5.4. 2. 2  Conclusion 

Limiting  the  numbers  of  different  microcircuit  types  that  can  be  used 
in  a  particular  system  design  relates  to  the  presently  used  practices  in  standard 
components  specifications,  in  that  type  limitation  can  effectively  bound  and  force 
standajxlization.  A  large-scale  move  in  DoD  programs  toward  component  types 
limitation  should,  in  the  long  term,  enable  the  purchase  of  better  quality  components. 
This  is  probably  true  for  the  reason  that  using  fewer  types  of  components  in  a  de¬ 
sign  program  should  permit  greater  effort  toward  achievir^  standard  levels  of 
high  reliability  for  ail  program  applications.  Reduced  life  cycle  cost  would  probably 
be  an  added  significant  benefit. 

5.4. 2. 3  Recommendation 

Constrain  systems  design  to  the  use  of  specific  microcircuit  types 
which  have  been  developed,  manufactured,  and  tested  by  techniques  that  will  en¬ 
sure  high  reliability.  Limit  and  control  the  use  of  nonstandard  devices  to  those 
applications  where  sufficient  resources  are  available  to  permit  an  orderly  de¬ 
velopment  and  qualification  phase  prior  to  inclusion  in  the  system. 

5.4.3  Specifications,  Procedures,  and  Controls 

5. 4. 3.1  Discussion 

Early  in  its  history  NASA  recognized  the  inherent  advantages  of  em¬ 
ploying  microcircuits  in  high-reliability  space  applications,  and  sought  ways  of 
capitalizing  on  the  then-burgeoning  microelectronic  technology.  Each  field 


installation  was,  at  that  time,  procuring  and  applying  mic-ocircuits  on  an  iadepenf’.ent 
basis  without  benefit  of  any  NASA-wide  specifications  or  standards  describing  per¬ 
formance  characteristics,  qualification  tests,  screen  or  acceptance  tests,  or  other 
basic  engineering  documents.  In  response  to  this  problem  and  to  the  urgent  need 

for  a  cohesive  and  coordinated  reliability  program,  NASA  Headquarters  embarked 
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on  a  multifaceted  plan'  '  to  provide  a  system  of  carefully  defined  surveys  and  evalua¬ 
tions,  specifications,  test,  and  data  exchange  methods.  Now  reasonably  mature^ 
this  system  attempts  to  provide  NASA  and  its  contractors  the  means  of  achieving 
uniformity  in  the  procurement  of  microcircuits  and  information  on  qualified  sources 
ox  supply.  By  its  application,  it  is  expected  that  procurement  can  be  speeded  up, 
duplication  of  effort  and  costs  can  be  reduced,  and  high-reliability  microcircuits 
can  be  developed  and  produced. 

NASA  has  also  utilized  the  concept  of  "line  certification"  as  a  means 
of  ensuring  that  microcircuits  for  NASA  programs  are  manufactured  under  condi¬ 
tions  that  have  been  demonstrated  to  be  capable  of  continuously  producing  highly 
reliable  products.  This  is  accomplished  by  evaluating,  in  advance  of  production 
procurement,  the  manufacturer's  capability  for  holding  his  own  key  processes 
within  established  limits  at  critical  points  and  maintaining  this  capability  during 
production'  \ 

The  DoD  has  only  recently  begun  writing  military  specifications  for 

microcircuits,  and  military  standards  are  not  yet  developed.  This  situation  led 

the  Military  Operatioqs  Subcommittee  of  the  House,  in  their  recent  study  of  the 

(4) 

military  supply  system,  to  conclude  that  "getting  contractors  to  use  selected  or 
qualified  items  presupposes  the  existence  and  availability  of  useful  listings  of 
these  items.  If  the  specifications  are  out  of  date  or  nonexistent,  it  is  futile  to 
expect  or  demand  that  contractors  use  specified  or  standard  parts.  An  essential 
element  of  the  military  standardization  program  is  the  development  of  usable 
specifications  and  standards.  "  The  Panel  further  concluded  that  "standards  and 
specifications  must  be  continually  updated  so  that  they  reflect  the  latest  advances 
in  technology  and  the  increasing  performance  and  reliability  requirements  demanded 
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from  contractors."  The  fact  that  military  reliability  requirements  are  increasing 
was  emphasized  by  Dr.  John  Foster,  Director  of  Defense  Research  aud  Engineering, 
in  his  recent  testimony  before  the  Senate  Appropriations  Committee  when  he  stated 
"The  dramatic  advances  being  made  in  electronics  technologj'  gives  us  a  major  op¬ 
portunity  to. .  .permit  the  development  of  ultrareliable  equipment  and  systems 
(thousands  versus  hundreds  of  hours  between  failures'  *hat  wll  drastically  reduce 
supporting  logistics  costs  (maintenance  personnel,  spare  parts  inventory,  training) 
and  increase  operational  availability. " 

5.4. 3.2  Conclusion 

Microelectronics,  because  cf  the  complex,  advanced  technology  em¬ 
ployed  in  their  man'jfacture,  must  be  controlled  by  a  sophisticated  and  timely 
system  of  specifications,  standards,  process  controls,  and  manufacturing  test 
procedures.  NASA  has  taken  significant  steps  to  accommodate  this  need  for  its 
own  applications  while  the  evidence  indicates  that  the  DoD  has  fallen  behind  in  ad¬ 
dressing  the  problem  for  military  systems. 

5. 4. 3. 3  Recommendations 

The  DoD  should  convene  a  task  group,  or  other  suitable  agency  to  de¬ 
velop  and  m.aintain  detailed  specifications,  standards,  and  process  control  docu¬ 
ments  that  will  qualify  microcircuits  for  use  in  military  applications.  The  NASA 
system  should  be  examined  for  applicability;  however,  it  is  not  the  recommendation 
of  the  Panel  that  the  current  NASA  system  be  adopted.  Rather,  qualified  individuals 
should  evaluate  its  merits  based  on  a  more  thorough  study  than  was  possible  in  this 
ctudy.  Microcircuit  standardization  efforts  should  be  accelerated,  with  special 
emphasis  placed  on  the  achievement  of  a  single  high  level  of  performance  and  re¬ 
liability  for  all  military  applications.  It  is  recognized  that  this  is  a  difficult  ob¬ 
jective  to  achieve,  but  the  potential  benefits  warrant  a  major  effort.  The  Military 
Operations  Subcommittee  seems  to  share  this  view  in  their  statement:  "If  a  military 
service,  or  preferably  the  entire  defense  establishment,  can  cause  a  specified  or 
standard  item  to  be  used  in  a  variety  of  applications,  the  vendor  often  is  able  to 
offer  it  at  a  better  price.  It  may  then  be  cheaper  to  use  the  more  sophisticated 
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item  in  all  aj^lications,  rather  than  continuing  to  order  various  items  with  grada- 

(4) 

tions  of  performance. " 

5.4.4  Manufacture  of  Reliable  Integrated  Circuits 

5.4.4. 1  Discussion 

Characteristic  of  all  special  programs  studied  was  the  recognition  of 
the  importance  of  establishment  and  control  of  a  high-reliability  integrated  circuit 
manufacturing  lin5.  Although  the  degree  of  effort  in  this  area  varied  with  the  size 
of  the  program  (i.  e, ,  a  very  large  program  maintained  a  "captive"  integrated  cir¬ 
cuit  production  line  while  a  smaller  program  contracted  for  the  manufacture  of  its 
integrated  circuits  in  terms  of  specific  processes,  personnel,  and  facilities  which 
had  previously  been  qualified),  the  interest  was  clearly  similar.  It  was  to  establish, 
through  thorough  evaluation,  the  reliability  or  quality  of  an  integrated  circuit  pro- 
duceil  by  a  given  process  and  then  to  maintain  the  stability  of  that  process  through¬ 
out  the  actual  production  period. 


It  is  interesting  and  significant  that  the  definition  of  process  control 
employed  by  these  programs  goes  beyond  the  requirement  for  process  documentation 
and  technology  certification  (such  as  is  contained  in  the  General  Military  Specifica¬ 
tion  for  Microcircuits  MIL-M-38510  and  the  NASA  Line  Certification  Requirements 
for  Microelectronics  NHB-5300. 4  (3C)'  '  in  that  it  recognizes  the  importance  of 
stability  in  personnel,  facilities,  and  production  rate  to  integrated-circuit  quality. 

(S) 

In  a  report  issued  by  the  M.  I.  T.  Instrumentation  Laboratory  based  on  Apollo 
guidance  co.  .puU”  experience,  the  adverse  impact  of  seemingly  innocuous  process 
changes,  personnel  changes,  and  production  discontinuity  is  discussed  and  illustra¬ 
ted;  emphasizing  the  need  for  a  stable  and  controlled  production  environment.  The 
success  of  the  Apollo  prcgrrm  in  procuring  large  quantities  of  reliable  integrated 
circuits  speaks  favorably  for  this  approach. 


(9) 

There  is  some  discussion  as  to  what  the  optimum  production  rate 
(i.  e. ,  fewer  than  10, 000  versus  more  than  100, 000  circuits  per  week)  for  a  given 
high-reliability  production  line  might  be;  however,  there  is  no  argument  that  some 
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rate  must  be  established  and  maintained  for  a  protracted  period  of  time.  In  other 

words,  it  seems  that  in  order  to  control  the  manufacture  of  integrated  circuits  to 

a  high  quality  there  has  to  be  a  willingness  to  commit  to  the  procurement  of  a  large 

quantity.  While  this  represents  no  fundamental  problem  to  the  few  major  programs 

that  require  a  large  quantity,  it  is  an  insurmountable  obstacle  to  the  average  DoD 

program.  On  the  other  hand,  the  sum  total  of  all  DoD  small  program  integrated 

circuit  requirements  is  numerically  enough  that  controlled,  reliable  integrated 

circuit  production  to  meet  this  requirement  could  economically  be  sustained.  It 

(4) 

was  recently  suggested  in  a  report  to  the  United  States  Congress  that  if  the  re¬ 
quirement  for  high-reliability  parts  were  large  enough,  the  economics  of  the  situa¬ 
tion  might  cause  certain  manufacturers  to  convert  to  high-reliability  manufacturing 
techniques  for  all  parts  produced.  In  this  vein,  it  could  be  conjectured  that  by  allow¬ 
ing  the  use  of  low'er-quality  integrated  circuits  in  less  critical  appUcaticns,  the  DoD 
is  destroying  the  high-reliability  production  base  which  could  make  it  economically 
feasible  to  use  a  high-reliability  integrated  circuit  in  every  DoD  application. 

5-4.4. 2  Conclusion 

Reliable  integrated  circuits  are  produced  on  tightly  controlled  and 
highly  stable  production  lines.  Since  the  establishment  of  such  a  line  is  beyond 
the  scope  of  most  individual  DoD  programs,  they  are  not  ah’e  to  ensure  the  reliability 
of  their  integrated  circuits.  The  DoD  requirements  for  standard  types  of  integrated 
circuits  when  considering  the  sum  total  of  all  program  needs  might  be  sufficiently 
large  to  allow  for  the  economical  establishment  and  maintenance  of  production  lines. 

5. 4. 4. 3  Re  commendation 

The  DoD  should  consider  contracting  with  industry  for  the  establishment 
and  maintenance  of  high-reliability  integrated-circuit  production  lines  to  produce  a 
single  quality  of  selected  standard  circuits  for  all  military  applications.  Obviously, 
means  must  be  found  to  consolidate  DoD  integrated  circuit  requirements  and  pro¬ 
curement  methods  such  that  production  rates  can  be  escablished  that  are  consistent 
with  program  requirements. 
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5.4.5  DoD  Management,  Procurement,  and  Techxiical  Surveillance 

5. 4. 5.1  Discussion 

Earlier  in  this  report  the  Panel  identified  as  a  critical  question: 

"Can  DoD  as  a  whole  use  its  immense  resources  and  purchasing  pow'er  to  achieve 
a  very  high  level  of  reliability  for  all  programs  without  burdening  each  individual 
program  with  the  high  cost  in  money  and  experienced  talent  which  is  usually  not 
available  to  the  "typical"  military  system?”  The  previous  recommendations  have 
focused  on  specific,  tangible  solutions  based  largely  upon  the  experience  of  success¬ 
ful  "special  programs. "  What  has  not  yet  been  addressed  is  the  means  of  ac¬ 
complishing  these  solutions  in  a  manner  that  will  reap  the  maximum  benefits  for 
the  DoD  and  semiconductor  industry  as  a  whole. 

The  Panel  was  impressed  that  the  successful  programs  were  these 
that  made  maximum  use  of  standardization  in  specifications,  standards,  process 
controls,  management,  and  procurement  procedures.  Other  "typical”  programs 
appeared  to  suffer  from  the  lack  of  standardization  of  these  key  elements,  as  well 
as  insufficient  purchasing  power  to  impact  the  manufacturers  adequately,  and  in¬ 
adequate  technical  staffs  to  understand  the  technology  and  supervise  the  development 
and  production  of  microelectronics  properly  for  their  programs. 

The  Defense  Electronic  Supply  Center  (DESC)  does  currently  have  the 
responsibility  for  centralized  procurement  of  electronic  components  for  in-house 
Defense  Department  requirements,  particularly  in  the  repair  and  maintenance 
fields.  DESC  appears  to  play  no  role  in  the  procurement  of  electionic  components 
for  use  by  industry  in  the  manufacture  of  military  systems  equipment.  Our  recom¬ 
mendation,  therefore,  implies  a  far  more  drastic  change  in  the  method  of  DoD  tech¬ 
nical  surveillance,  management,  and  procurement  of  microelectronic  components 
than  is  involved  in  the  DESC  operation. 
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5. 4. 5. 2  Conclusion 

Consolidation  of  management,  procurement,  and  technical  surveillance 
by  "special"  programs  has  proved  to  be  effective  in  obtaining  highly  reliable  micro¬ 
electronic  components.  Further  consolidation,  across  programs  and  services,  ap¬ 
pears  to  hold  the  promise  of  achieving  even  greater  progress  toward  the  goal  of 
maximizing  total  systeni  cost  effectiveness.  The  DoD  appears  to  be  in  a  singularly 
good  position  to  accomplish  this  <~'>nsolidation. 

5.4. 5.3  Recommendation 

The  DoD  should  study  the  feasibility  of  structuring  a  single  agency, 
either  within  DoD  or  sponsored  by  DoD,  with  the  authority  and  responsibility  for 
consolidating  the  management,  procurement,  and  technical  surveillance  of  all 
microelectronics  for  military  applications.  Consideration  should  be  given  to  in¬ 
viting  NASA  participation  and  support  in  the  study. 

5.4.3  Microelectronic  Research  and  Development 

5. 4. 6.1  Discussion 

The  implementation  of  the  above  recommendations  will  of  necessity 
tend  to  limit  the  system  application  of  microelectronics  to  available  circuit  types 
with  proven  reliability  and  high  volume  usage.  This  will  result  in  a  dangerous  in¬ 
hibition  of  new  technological  developments  that  are  essential  for  the  improved 
performance  of  our  military  systems.  A  technique  must  therefore  be  developed 
that  will  encourage  new  and  innovative  state-of-the-art  research  and  development, 
and  a  method  must  be  devised  to  ensure  the  inclusion  of  reliability  as  an  essential 
element  in  these  microelectronic  research  and  development  programs.  Furthex  - 
more,  system  program  offices  will  have  to  be  encouraged  to  make  effective  use  of 
these  state-of-the-art  developments  as  appropriate. 

5.4.fe.2  Conclusion 

New  high-reliability  microelectronic  devices  come  into  being  through 
a  concerted  eftcH  encompassing  research  and  development,  which  includes  reliability 
studies.  To  expect  the  majority  of  individual  programs  successfully  to  manage  this 
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complex  technological  process  is  unrealistic  because  there  are  too  many  such 
programs  and  they  are  too  small. 

5.4.6. 3  Recommendation 

The  DoD,  with  the  assistance  of  the  Advisory  Group  on  Electron 
Devices,  should  establish  avenues  and  controls  for  ensuring  a  continuing  ad¬ 
vancement  in  the  state  of  the  art  in  microelectronic  devices,  while  simultaneously 
ensuring  that  only  devices  with  demonstrated  performance  and  reliability  are 
permitted  to  be  introduced  into  system  applications. 
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APPEMMv:  case  HISTORY 


RELIABLE  IC’S 

A  DO  IT  YOURSELF  PROJECT 

JUNE  1971 


general  electric  company 

AEROSPACE  ELECTRONIC  SYSTEMS  DEPARTMENT 
UTICA,  NEW  YORK  13503 


GENERAL 


ELECTRIC 


Preceding  page  blank  75 


If  reliable  devices  are  available ,  then  why  as  a  user 
do  we  concentrate  our  technical  resources  in  integrated 

circuit  procurement?  Figure  1 


Figure  2  Figure  3 
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